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Differential  game  theory  is  applied  to  several 
classes  of  pursuit-evasion  problems.  For  these 
differential  games  the  dynamics  of  the  participants 
are  described  by  linear  nonstationary  differential 
equations. 

One  class  of  differential  games  that  was  formu¬ 
lated  and  studied  is  the  differential  game,  where  the 
evader' has  to  out  maneuver  a  pursuer,  if  it  is  to 
strike  the  target  that  the  pursuer  is  defending. 

This  differential  game  will  be  called  the  differ¬ 
ential  endgame. 

The  differential  endgame’s  payoff  functional 
is  the  square  of  the  terminal  engagement  miss 
distance  weighted  against  the  difference  of  the 
participants'  control  energies,  spent  during  their 
respective  flight  times.  The  evader's  target 
constraints  are  the  position  coordinates  of  the 
target  and  the  evader's  kinetic  energy  as  it 
strikes  the  target. 


The  necessary  and  sufficient  conditions  for 
the  existence  of  a  saddle  pointy  and  the  partici¬ 
pants'  control  algorithms  are  determined  for 
this  differential  endgame. 

For  this  type  of  differential  endgame  when 
the  intercept  and  target  times ,,  and  the  pursuer's 
initial  position  and  velocity  vectors,  constrained 
in  magnitude.,,  are  unknown,,  the.  relationships,  that 
determine  these  parameters,  are  derived. 

For  a  class  of  differential  games,  which 
results  when  the  evader's  target  constraints  and 
postengagement  flight  time  are  not  considered,  it 
is  shown  how  the  relationships  that  determine  the 
intercept  time  and  the  pursuer's  initial  state 
are  used  in  determining  when  the  pursuer  is 
launched. 

Another  class  of  differential  games,  formu¬ 
lated  and  studied  in  this  dissertation,  is  the 
one  where  an  additional  pursuer  is  cooperating 
with  the  primary  pursuer  that  is  trying  to 
intercept  the  evader.  Here  the  payoff  functional, 
which  is  constrained  by  the  inner  product  of  the 
terminal  miss  vector  between  the  cooperating 
pursuer  and  the  evader,  is  the-  square  of  the 
terminal  miss  distance  between  the  primary 
pursuer  and  the  evader,  weighted  against  the  dif¬ 
ference  of  their  control  energies.  For  this 
differential  game  the  two  point  boundary  value 
problem  is  derived  and  solved. 
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•PURSUIT-EVASION  DIFFERENTIAL  GAMES 


1 .  ..INTRODUCTION 
1.1  HISTORICAL  BACKGROUND 

In  1954  Isaacs  (1,  2)*  studied  the  pursuit  problem  by 
trying  to  -determine  the  optimal  path  for  a  pursuer  in  order 
to  intercept  maneuverable  targets.  Isaacs'  formal  and 
hueristic  approach,  which  was-  similar  to  Bellman's  dynamic 
programming  method,  initiated  the  study  of  differential 
games. 

In  1957  Berkovitz  and  Fleming  (3)  applied  the  calculus 
of  variations  technique  to  a  class  of  differential  games. 
Later  Berkovitz  (4)  gave  a  rigorous  treatment  of  a  wider 
class  of  differential  games,  based  upon  the  calculus  of 
variations.  Here  Berkovitz  obtained  the  necessary  con¬ 
ditions  that  must  exist  along  a  path  resulting  from  the 
use  of  optimal  strategies  of  the  two  adversaries,  by 
relating  the  differential  game  problem  to  a  Bolza  problem 
with  differential  inequalities  added  as  side  constraints-. 

*The  numbers  in  parentheses  indicate  references  in  the 
Bibliography. 
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Berkovitz  also  developed  a  sufficiency  theory  which  in 
principle  verifies  the  existence  of  a  saddle  point. 

Kelendzheridze  (S)  studied  the  problem  of  two  maneu¬ 
verable  adversaries  to  which  he  determined  the  minimax 
time  it  takes  for  the  pursuer  to  capture  an  evader.  Here 
he  used  the  minimax  analogue  of  the  Maximum  Principle  to 
determine  the  necessary  conditions  for  optimality. 

Ho,  Bryson,  and  Baron  (6,7),  assuming  the  existence 
of  a  saddle  point,  ujed  variational  techniques  to  derive 
conditions  for  capture  and  optimality  of  a  linear  class  of 
differential  games.  These  conditions  depend  on  the 
authors'  definition  of  the  relative  controllability  matrix. 
Baron  (8),  assuming  the  existence  of  a  saddle  point,  derived 
conditions  for  capture  and  optimality  for  a  linear  class 
of  differential  games  where  the  adversaries  have  limited 
energy  resources  or  where  the  magnitudes  of  the  control 
forces  are  limited.  Baron  also  derived  necessary  and  suf¬ 
ficient  conditions  for  a  class  of  nonlinear  differential 
games.  Gahzhiev  (9)  solved  a  similar  version  of  the 
problem  that  was  studied  by  Ho  et  al  (6,7)  but  without  the 
relative  controllability  condition. 

More  recently  Meschler  (10 )  and  Chattopadhyay  (n ) 
have  formulated  pursuit-evasion  problems  where  the  objec¬ 
tives  of  the  evader  are  not  only  to  avoid  interception  of 
the  pursuer  but  also  to  strike  the  target,  the  pursuer  is 
defending. 
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Meschler  has  formulated  his  pursuit-evasion  problem  as 
a  differential  game.  Its  payoff  is  the  square  of  the 
terminal  miss  distance.  The  dynamics  of  the  participants 
are  represented  by  linear  time-invariant  differential 
equations  and  the  participants'  control  force  components 
have  specified  magnitude  constraints.  Here  the  extremum 
of  this  differential  game  is  determined  analytically  by 
dynamic  programming.  A  serious  drawback  of  this  differ¬ 
ential  game  is  that  it  was  optimized  with  respect  to  one 
component  of  the  participants'  control  vectors.  Meschler' s 
work  was  published  after  the  solutions  for  this  dissertation 
were  obtained.  In  the  pursuit-evasion  problem  studied  by 
Chattopadhyay ,  although  it  contains  the  notion  of  the 
pursuer  defending  the  evader's  target,  it  is  not  a  differ¬ 
ential  game  because  the  trajectory  of  the  evader  is  pre¬ 
determined. 

1.2  SCOPE  OF  INVESTIGATION 

One  of  the  objectives  of  this  dissertation  is  to  apply 
differential  game  theory  to  the  endgame  problem.  The  end¬ 
game  problem  is  defined  as  the  terminal  flight  stage  of  an 
offensive  missile  that  tries  to  penetrate  its  target  by 
out  maneuvering  a  maneuverable  pursuer.  This  class  of 
differential  games  will  be  called  the  differential  endgame. 

For  this  differential  endgame  the  payoff  functional 
is  the  square  of  the  terminal  engagement  miss  distance, 
weighted  against  the  difference  of  the  control  energies, 
spent  by  the  participants  during  their  respective  flight 
times . 
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The  dynamics  of  the  participants  are  described,  by 
linear  time-varying  differential  equations.  The  evader's 
target  constraints  are  the  position  coordinates  of  the 
target  and  the  evader's  target  speed  which  is  a  measure  of 
the  evader ' s 'terminal  kinetic  energy. 

For  this  differential  endgame  the  necessary  and  suf¬ 
ficient  conditions  for  the  existence  of  a  saddle  point  are 
derived  by  the  calculus  of  variations  method.  From  these 
necessary  conditions-  control  algorithms  are  developed  for 
the  participants. 

Meschler  (10)  is  the  only  one  who  studied  the  endgame 
problem  in  terms'  of  differential  game  theory.  His  work 
was  published  after  the  solution  to  the  differential 
endgame  problem  proposed  in  Chapter  3  was  obtained.  In 
Meschler' s  differential  endgame  the  payoff  functional  is  the 
square  of  the  terminal  engagement's  miss  distance.  The 
dynamics  of  the  participants  are  defined  by  linear  time- 
invariant  differential  equations.  The  target  constraint  is 
^  target  zone.  Here  the  minimax  value  of  the  differential 
game  is  determined  with  respect  to  one  component  of  the 
participants’  control  vectors.  This  component  of  the 
participants'  control  vectors  is  constrained  in  magnitude. 
This  differential  endgame  is  solved  by  dynamic  programming. 

In  all  previous  classes  of  pursuit-evasion  differ¬ 
ential  games  important  parameters  such  as  the  intercept 
time,  target  time,  and  the  pursuer's  initial  position  and 
velocity  vectors  were  assummcd  to  be  some  known  values. 
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In  Chapter  4  these  parameters  are  considered  unknown  and 
they  are  determined  via  differential  game  theory.  For 
these  differential  games  the  pursuer's  unknown  prosit  ion 
and  velocity  vectors  have  constrained  magnitudes.  Here 
the  necessary  conditions  needed  to  determine  these  optimal 
parameters  are  derived  for  these  classes  of  differential 
games.  Also  in  Chapter  4  it  is  shown  how  the  differential 
game  with  its  optimized  parameters  is  used  to  determine 
when  the  pursuer  is  launched. 

Finally,  in  Chapter  5  a  class  of  differential  games 
involving  two  pursuers,  trying  to  intercept  an  evader,  is 
formulated.  The  two  point  boundary  value  problem,  which 
determines  the  value  of  this  type  of  differential  game, 
is  derived  by  the  calculus  of  variations  method.  The 
solution  of  this  two  point  boundary  value  problem  is 
determined. 
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2.  DIFFERENTIAL  GAMES 


2.1  PARTICIPANTS’  LINEAR  NONSTATIONARY  SYSTEMS 


Both  participants  of  the  differential  games  studied  in 
this  dissertation  have  linear,  nonstationary,  continuous 
systems  of  the  following  form: 


X  = 

F  ( t )  x  + 

G  (t)  u  +  n 

(2.1.1) 

p 

P  P 

.P  P 

• 

xe  = 

F  (t)x  + 
e  e 

G  (t)  v  +  n 
e  e 

(2.1.2) 

where  x  and  x  are  n-vectors  describing  the  state  of  the 
pursuer  and  evader  respectively;  u  and  v  are  m-vectors, 
representing  the  control  vectors  of  the  pursuer  and  evader 
respectively;  n  and  n  are  n-vectors,  representing  any 

p  e 

disturbance  acting  upon  the  pursuer  and  evader;  Fp(t) 
and  Fe(t)  are  nxn  matrices,  continuous  in  t;  and 
G  (t)  and  G_(t)  are  nxm  matrices,  continuous  in  t. 

p  t; 

The  participants’  state  vectors  are  determined  by 
solving  the  set  of  differential  equations,  describing 
their  systems, 


x  (t)=9  (t,t0)x  (t0)+  /©, (t,r)^G  (r)u(r)+n  Cr)3dr  (2.1.3) 


xe(t)=3?e(t  ,t0)xe(t0)  +  y'^)e(t,r)[Ge(r)v(r)+ne(r  )]dr  (2.1.4) 


where  d}D(t  ,tg)  and  <£>e(t  ,tQ) ,  the  state  transition  matriceSj 
are  the  solutions  of  the  following  set  of  differential 
equations: 


<£K(t,t0)  =  Fk(t)Cpk(t  ,tQ) ;  *=P,e 

subject  to  the,  initial  conditions 


(2.1.5) 


^  n  >  "*■  n  ^  ~  ^ 


(2.1.6) 


Since  the  state  transition  matrix  is  used  to  derive  the 
optimal  solution  of  the  differential  games  that  are  formulated 
in  this  dissertation,  it  is  appropriate  to  point  out  the  fol¬ 
lowing  properties  of  the  state  transition  matrix.  Proof  of 
these  statements  is  in  ( 1 2  )  • 

1)  By  definition 

<£>(t,t)  =  I  (2.1.7) 

2)  The  group  property  of  the  state  transition  matrix  is 

^>(t2,tQ)  =  C[xt2  ,t1>^)(t1,t0)  (2.1.8) 

3)  The  inverse  of  the  state  transition  matrix  is 

(jj1  (t ,  t  )  =  ^>(r,t)  (2.1.9) 

In  physical  terms  the  participants'  state  vectors 
represent  their  position  and  velocity  components.  The 
position  vector  for  the  participants  is  defined  as 

Xkl=Axk’  '2.1.10) 

where  the  2mxm  matrix  A  is  partitioned  into  the  rnxrn 
identity  and  null  matrices 

A  =  [1:0]  (2.1.11) 

The  velocity  vector,  for  the  participants  is  defined  as 

xk2  =  Qxk;  k=p,e  (2.1.12) 

where  the  2mxm  matrix,  Q,  is  partitioned  into  the  mxm 
null  and  identity  matrices 

Q  =  [0:1]  (2-.1.13) 

The  participants'  position,  velocity,  and  control 
vectors  are  considered  to  be  three  dimensional  vectors  for 
the  differential  games  studied  in  this  dissertation. 


My 
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2.2  GENERAL  DEFINITION  OF  A  DIFFERENTIAL  GAME 

The  basic  differential  game  problem  is  nonrigorously 

condensed  from  Berkowitz  (4)  as  follows: 

For  the  payoff  functional 

-T 

J  =  ?'(x(T),T)  +  /  L(x,u,v,t)dt  (2.2.1) 

and  the  participants' optimal  strategies,  u*  and  v  * , 
determine  W(x0,tg),  the  value  of  J,  such  that* 

W(xn,tn)  =  MinMax  J  (2.2.2) 

u  u  uEUvSV 

subject  to  the  constraints 

x  =  F(x,u,v,t )  (2.2.3) 

x(tQ)  =  xQ  (2.2.4) 

and- 

uEU(t),  vGV(t)  (2.2.5) 

Here  x(t),  which  is  defined  as  the  state  of  the  game,  is 
composed  of  the  pursuer's  and  the  evader's  state  vectors, 
and  u  and  v  are  the  control  vectors  of  the  pursuer  and 
evader,  respectively.  T  is  the  fixed  termination  time  of 
the  game,  and  the  game's  fixed  time  interval  is  [tQ,T]. 
lI,(x(T),T)  is  some  terminal  nonlinear  function  of  the  state 
variables  of  the  game,  and  L(u,v,x,t)  is  some  nonlinear 
penalty  functional  of  the  control  energy  spent  by  both 
players . 

Now  a  saddle  point  for  the  differential  game  is 
defined  as  the  pair  (u*,v*)  satisfying  the  relation 

J(u*,v)  -  J ( u* , v* )  ^  J(u,vlV)  (2.2.6) 

*It  is  assumed  that  MinMax  J  =  MaxMin  J 

uSUvSV  vEVuGU 
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for  arbitrary  uGU,  v£V.  If  and  only  if  (2.2,6)  is  satisfied, 
u*  and  v*  are  optimal  strategies  and  J(u*  ,v*)=W(Xq  ,tg ) . 

2 . 3  FEEDBACK  CONTROL  LAWS 

There  are  two  types  of  control  strategies,  one  is 
open  loop  control  and  the  other  is  closed-  loop  control. 

The  open  loop  controls  are  admissible  controls  which  deter¬ 
mine  the  saddle  point  for  (2.2.1)  subject  to  (2.2.3— 2.2*5) 

The  open  loop  controls  are  optimum  for  a  particular  initial 
state  and  its  corresponding  optimal  path. 

U*  =  h1(xQ,t0,t)  (2.3.1) 

v*  =  h2(x0,tQ,t)  (2.3.2) 

Closed  loop  optimal  controls  are  optimum  for  any  initial 
state  and  any  deviation  from  the  optimal  nominal  trajec¬ 
tories  along  these  optimal  nominal  trajectories 


U*aki(x0,t0,x,t) 

(2.3.3) 

v*=k2 (xQ ,tQ ,x,t) 

(2.3.4) 

Although  optimal  closed  loop  controls ,  which  are 
determined  by  solving  the  Hamilton-Jacobi  equation,  are 
more  desirable  than'  the  optimal  open  loop  controls,  the 
optimal  open  loop  controls  are  determined  because  it  is 
easier  to  solve  the  two  point  boundary  value  problem  than 
the  Hamilton-Jacobi  equation.  The  optimal  open  loop  con¬ 
trols  can  approximate  closed  loop  control  by  instanta¬ 
neously  and  continuously  computing  optimal  open  loop 
controls  from  updated  measurements  on  the  present  state 
of  the  game. 
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These  optimal  open  loop  strategies  are  derived  by  the 
calculus  of  variations  method. 

2.4  NECESSARY  AND  SUFFICIENT  CONDITIONS 
FOR  THE  DIFFERENTIAL  GAME 


The  calculus  of  variations  technique  is  used  to  derive 
both  the  necessary  conditions  which  must  be  satisfied  if 
a  saddle  point  for  the  differential  game  exists,  and  the 
set  of  sufficiency  conditions,  which  determine  the  saddle 
point.  From  the  necessary  conditions  the  optimal  open 
loop  strategies  are  derived.  The  differential  game’s 
value  and  the  participants'  optimal  control  strategies  are 
determined  when 


Min  Max  J  =  Hin  Maxj 
uGU  vGV  uGU  vGV  ' 


¥(x(T),T)  + 


T 

/  [L(x,u,v,t)+ 

t0 


X'  F(x,u,v,t )-  X'  x]dt| 

Now  defining  the  Hamiltonian  as 
H(x,\,u,v,t)  =  L(x,u,v,t)  +  X'F(x,u,v,t) 


(2.4.1) 


(2.4.2) 


one  can  rewrite  the  minimax  operation  (2.4.1)  as 


Min  Max  J 
uGU  vGV 


where  tQ,  T,  and  x(tQ)  are  fixed,  and  x(T)  is  free. 

The  variation  ofJis  written  in  the  following  form 

AJC=  §Jc+  S2Jc  (2.4.4) 

2 

where  §Jcis  the  first  order  variation  and  o  Jcis  the  second 
order  variation. 

The  necessary  conditions  that  must  be  satisfied  over 
the  time  interval  Ctg,T3  if  Jchas  a  saddle  point  for  the 
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strategies  v  =  v*  and  u  =  u*  are: 

1)  The  Euler-Lagrange  equations  and  the  boundary  condi¬ 
tions  must  be  satisfied  such  that  BJ  is  zero. 

2)  The  analogous  Legendre-Clebsch  conditions  satisfy 

‘  Juu  ^  0  (2.4.5) 

JVVS  0  '  (2.4.6) 

3)  Nonexistence  of  a  conjugate  point  for  the  accessory 
minimax  problem. 


If  J  has  a  saddle  point  for  the  control  strategies 
u  =  u*  and  v  =  v  *  t  h  e  n  t  he  f  ollowing  conditions  are 
sufficient  if  they  are  satisfied  simultaneously: 

1)  u*  and  v*  satisfy  the  Euler-Lagrange  equations 
and  their  boundary  conditions. 

2)  Along  u5’  and  v- *  (2.4.5)  and  (2.4.6)  are  satisfied 
over  the  interval  Ct0>T]. 

3)  No  conjugate  points  exist  over  the  interval  [tQ,T]  for 
the  accessory  minimax  problem. 

2.4.1  Determination  of  the  Euler-Lagrange 

Equations  and  their  Boundary  Conditions 
The  variation  of  the  constrained  payoff  functional, 
Jc,  excluding  all  terms  higher  than  second  order  is 
AJc=  »^x5x(T)  +  Sx(T)  !VI'xxSx(T).  -  X(T)  'Sx(T)  + 


ft  (<Hx  +  V>8*  +  Hu5u  +  Hv8v)dt  + 

°  T  .  FxAAvf* 

1/2  /  [SxMiu-iSvU  H UXHUUH-  Su  dt 


rH  H  H  1 

Bx 

. 

XX  XU  XV 

I — 1 

> 

co 

H  H  H- 

5u 

• 

UX  UU  uv 

H  H  H 

8v 

L  VX  VU  VVJ 

■(2.4.7) 
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Requiring  the  first  order  variation  to  vanish  on  an 
optimal  trajectory  and  control  leads  to  the  Euler-Lagrange 
equations  and  their  boundary  conditions  from  which  the 
optimal  strategies  of  the  pursuer  and  evader  can  be  deter¬ 
mined.  The  first  order  variation  is  set  to  zero  by 
equating  the  coefficients  of  the  variational's  equal  to 
zero.  This  leads  to  the  Euler-Lagrange  equations 

H  +  A'  =  0  (2.4.8) 

X 

Hu  =  0  (2.4.9) 

Hy  =  0  (2.4.10) 

The  set  of  terminal  boundary  conditions  for  the  state 
vector  x(t)  and  costate  vector  A(t)  are: 

-  A(T)  =  0  (2.4.11) 

=  xQ  '  (2.4.12) 

Equations  (2.4.8)  and  (2.2.3)  are  the  differential  equations 
representing  the  unknown  nth  order  state  vector  x(t)  and 
the  unknown  nth  order  costate  vector  A(t).  Equation  (2.4.11) 
represents  the  terminal  boundary  conditions  of  the  costate 
vector,  and  equation  (2.4.12)  is  the  initial  boundary  con¬ 
dition  of  the  state  vector.  The  solution  of  equations 
(2.4. 8—2.4.12)  and  (2..2.3)  determines  x(t)  and  A(t). 

Knowing  x(t)  and  A(t),  the  participants'  optimal  open  loop 
strategies  are  determined  by  (2.4.9,2.4.10' 

2.4.2  Determination  of  the  Analogous 
Legendre-Clebsch  Conditions 
The  Legendre  conditions  that  must  be  satisfied  if  a 


saddle  point  exists  are 


J  =  H  =  0 
uu  uu 


(2.4.13) 


J  =  H  i  0 
vv  vv 


(2.4.14) 


These  are  a  direct  analogy  to  the  two-sided  calculus 
extremum  problem. 

2.4.3  Conjugate  Point  Problem 

One  of  the  sufficiency  conditions  that  form  the  set 
of  sufficiency  conditions  is  the  nonexistence  of  a  conjugate 
point  along  the  optimal  path.  The  following  definition  of 
a  conjugate  point  for  the  differential  game  is  similar  to 
the  one  .for  the  one-sided  optimization  problem  (13). 
Definition  1:  The  point  a(?*a)  is  said  to  be  conjugate  to 
the  point  a,  if  the  Euler-Lagrange  equations  for  the  dif¬ 
ferential  game  have  a  solution  which  vanishes  for  t=a  and 
t=a,  but  is  not  identically  zero.  Another  definition  of 
a  conjugate  point  which  can  be  used  to  formulate  a  pro¬ 
cedure  for  determining  the  existence  of  a  conjugate 
point  is  Definition  2  :  The  point  t=a  is  said  to  be 
conjugate  to  the  point  t=a  with  respect  to  the  payoff 
functional  of  the  differential  game  if  it  is  conjugate  to 
t=a  with  respect  to'  its  second  order  variation. 

2.4.4  Procedure  for  Determining  the 
Existence  of  a  Conjugate  Point 

If  the  necessary  conditions  exist  such  that  the  first 
variation  vanishes,  the  total  variation  of  the  payoff 
functional  (2.2.1)  is  reduced  to  the  following 

'T  K  H  K  I  IS x| 

AJ=Sx(T)’'i'_ „  Sx(T)+  f  CSx':  Su'jSv'3  xx  xu  *xv  L.  dt  o.u.i 
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subject  to  the  constraints 

Sx  =  F  xSx  +  Fu5u+Fv5v  (2.4.16) 

Sx(tQ)  =  0  (2.4.17) 


Now  according  to  Definition  2  a  test  is  devised  to  determine 
whether  conjugate  points  exist  for  the  quadratic  functional 
(2.4.15)  subject  to  the  constraints  defined  by  (2.4,16)  and 
(2.4.17).  This-  procedure  is  called  the  accessory  minimax 
problem.  This  is  analogous  to  the  one-sided  accessory 
minimum (maximum)  problem  (14). 

2.4.4  Accessory  Minimax  Problem 

Adjoining  the  differential  constraint  of  equation 
(2.416)  to  the  quadratic  second  order  variational 


Sx' 

T 

AJc=Sx(T)'^xxSx(T)+  J  J  [$x.,:Su,JSv‘] 

t0 

XX  XU  Xv 
H  H  H 

Su 

uv  uu  uv 
H  „  H  H 

Sv 

vx  vu  vv 

SA*  (F  Sx+F  §u+ FJ v- Sx )  1  dt  (2.4.18) 

X  u  /  ) 


and  redefining 

Sx  =  y 
Su  =  >? 

Sv  =  v 
SA  =  M 

the  Hamiltonian  for  (2.4.18)  is 


H(/iJ’?,l/,y,t)  =  [.  y';  r)  'J  v  '  ] 


ru 

XX 

H 

xu 

"xv-j 

'y' 

H 

uv 

H 

uu 

Huv 

.H 

H 

H 

V 

vx 

vu 

vvJ 

(2.4.19) 

(2.4.20) 

(2.4.21) 

(2.4.22) 


/A,(Fxy+Fu1,+  ?vv-) 


(2.4.23) 
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and 

’A  (y  (T)  ,T)  =  SxCTJ'^SxCT)  (2.4.24) 

The  second  order  variation  can  be  written  as 

T 

AJc  =  <//(y(T)  ,T)  +  /(  K(/i,r?Jr,y)t)-M,y)dt  (2.4.25) 

t0 


Now  the  necessary  conditions  for  an  extremum  of  AJ,are  the 
Euler-Lagrange  equations 


y  =  Fxy+  Furj+  Fv  ^ 

H/x  +  A  =  0 
H  ^  =  0 

=  0 

subject  to  the  boundary  conditions 
y(tQ)  =  0 

/^(T)  =  ^Ay(y(T),T) 


(2.4.26) 

(2.4.27) 

(2.4.28) 

(2. 4.29) 


(2.4.30) 


(2.4.31) 


It  is  possible  to  devise  the  following  test  for  the 
existence  of  conjugate  points.  From  (2.4.31)  one  sees  that 
there  are  2n  unknowns  and  n  equations.  Assuming  that  (2.4.31) 
is  linearly  independent,  one  can  in  principle  solve  n 
unknowns  in  terms  of  the  n  unknowns  which  are  free.  The 
free  unknowns  are  labeled  as  y%(T).Y(T)>  which  is  composed 
of  the  column  vectors  y . (T), is  defined  as 

fl  o] 


Y(T)  =  [y1(T)-*-yn(T)J  = 


(2.4.32) 


0 


1 


16 


Now  corresponding  to  these  choices  of  y^(T)  vectors,  one 
can  determine  the  /^(T)  vectors  from  (2.4.31)  and  form  the 
matrix : 

ACT)  =  [/^(T)*  •  *Mn(T)3  (2.4.33) 

After  obtaining  matrix  solution  of  the  Euler-Lagrange 
equations  (2.4.26-2.4.2  9)  with  boundary  conditions  Y(T)  and 
A(T),  if  Y(t)  becomes  singular  at  some  time  t  during  the 
interval  [tQ  ,T  3,  then  a  conjugate  point  of  Y(t)  exists  on 
the  interval  [t0,T'3. 

2 . 5  SUMMARY 

The  purposes  of  this  chapter  are: 

1)  To  define  the  dynamics  of  the  participants  for  the 

type  of  differential  games  studied  in  this  dissertation. 
2>  To  illustrate  the  general  concept 'of  the  differential 
game  and  the  techniques  for  determining  the  necessary 
and  sufficient  conditions  for  the  differential  game. 
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3.  DIFFERENTIAL  ENDGAME 


3 . 1  INTRODUCTION 

The  endgame  problem  is  one  where  an  offensive  type 
missile  has  to  out  maneuver  an  antimissile  if  it  is  to 
strike  its  target.  It  is  the  purpose  of  this  chapter  to 
place  the  endgame  problem  within  the  framework  of  differential 
game  theory.  This  particular  type  of  differential  game  will 
be  called  the  "differential  endgame".  The  necessary  and 
sufficient  conditions  for  The  existence  of  the  differential 
endgame's  saddle  point  are  determined. 

3.2  FORMULATION  OF  THE  DIFFERENTIAL  ENDGAME 


The  special  class  of  differential  endgame  to  be  studied 
is  as  follows : 


For  the  payoff  functional 
2 

J=~-[x  (Tn  )-x  (T-  )  ]  ' A' A[x  <T,)-x  (TrD] 
z  p  x  ex 


+  1/2 


P  x  e  1 

T  T 

' R_ (t )udt  -  1/2  J2v’ReCt)vdt 

t0  t0 


f*  p 


(3.2.1) 


and  the  participants'  optimal  strategies,  u*  and  v*, 
determine  WCx^tg),  'xe(tg)  ,tg),  the  value  of  the  game,  such 
that 


W(xT,(tn)  jX^Ctf^)  ,tQ)  =  Min  Max  J 


p  0  »  e  0 


u6U  vev 


subject  to  the  constraints 

x  =F  (t)x  +G(t )u+n 
P  P  P  P  P 


x  =F  (t)x  +G  (t)v+n 
e  e  e  e  e 


(3.2.2) 


(3.2.3) 


(3.2.4) 
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W  =  xeO 


xel(V  =  0 


xe2(T2) 'xe2(T2) 


and 


u,vSR°  . 


(3.2.6) 

(3.2.7) 

(3.2.8) 

(3.2.9) 


where  the  state  vectors,  x^  and  xg ,  represent  the  position 

and  velocity  components  of  the  pursuer  and  evader;  the 

control  vectors,  u  and  v,  represent  the  components  of  the 

pursuer's  and  evader's  acceleration  commands*,  n  and  n 

P  ® 

represent  any  disturbance  vectors  such  as  the  earth's 
.  3 

gravitational  field*,  R  is  the  three  dimensional  open 

Euclidean  space;  the  6x6  matrices,  Fp(t)'  and  Fe(t),  and  the 

6x3  matrices,  G  Ct)  and  G  (t),are  continuous  in  time;  R  (t) 
p  e  p 

and  Re-('t)  are  3x3  positive  definite  matrices,  continuous  in 

.  2 

time;  a  is  a  weighting  factor. 

The  differential  endgame  considered  in  this  chapter 
has  a  finite  duration  of(T2-tg),  tg  being  the  fixed  com¬ 
mencement  time  of  the  game,  and  T2  being  the  evader's  fixed 
target  time.  The  differential  endgame  has  a  finite  engage¬ 
ment  interval  (T^-tg),  T^  being  the  fixed  terminal  engagement 
or  intercept  time.  The  postengagement  time  interval  of  the 
differential  endgame  is^-T^). 

For  the  differential  endgame  the  payoff  functional 
proposed  by  (3.2.1)  is  the  engagement's  final  miss  distance, 
squared,  weighted  against  the  difference  of  the  control 
energies  spent  by  the  participants.  The  pursuer's  control 
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energy  is  spent  over  the  engagement  interval  and  the  evader* 
control  energy  is  spent  over  the  duration  of  the  game.  When 
interception  occurs  the  evader's  postengagement  trajectory 
is  the  optimal  path  it  would  have  if  it  were  not  destroyed. 

Both  participants  have  linear  nonstationary  dynamics, 
defined  by  the  differential  constraints  (3.2^3,  3.2.4). 

In  order  to  facilitate  the  application  of  the  method 
of  Lagrangian  multipliers  the  evader’s  differential  con¬ 
straint  over  the  postengagement  interval  is  converted  to  an 
integral  constraint 

VVs®e(T2»Tl)xe<V  + 
h 

J  CDe(T2,t)[Ge(t)v(t)+ne(t)]dt;  T1<  t £ T2  (3.2.10) 

T], 

where  <^)e(T2  ,t)  is  the  evader's  state  transition  matrix  and 
XgCT-^ )  and  xe(?2)  are  the  evader's  state  vectors  at  the 
intercept  and  target  times  respectively. 

The  evader's  target  constraints  are  expressed  by 
(3.2.7,  3.2. 8).  Equation  (3.2.7)  defines  "the 

evader's  target  position  vector,  which  is  the  origin  of  the 
differential  endgame's  coordinate  system.  By  specifying 
.the  inner  product  of  the  evader's  target  velocity  vector 
(3.2.8)  represents  a  measure  of  the  evader's  kinetic  energy 
as  it  strikes  the  target. 

In  conclusion,  the  interpretation  of  this  differential 
endgame  is  that  at  some  fixed  time,  T^,  the  pursuer  tries 
to  intercept  an  evader,  which  is  attempting  to  penetrate 
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the  pursuer's  defense  in  order  to  strike  its  target  at  some 
fixed  time  T2>  Both  participants  have  limited  energy 
sources.  An  open-loop  version  of  this  endgame  problem  is 
considered  since  the  optimal  control  forces  of  the  partic¬ 
ipants  are  considered  only  as  functions  of  time. 

Variational  calculus  as  applied  to  one-sided  optimal 
control  problems  (14 ,  15)  is  applied  to  the  differential 
endgame  problem  as  follows.  Vector  Lagrangian  multipliers 

A  and  A  are  introduced  in  order  to  adjoin  the  differential 
p  e 

constraints  (3.2.3)  and  (3.2.4)  to  the  payoff  functional 

(3.2.1)  over  the  engagement  interval.  Also  the  vector 

Lagrangian  multiplier  ji  adjoins  over  the  postengagement 

interval  the  integral  constraint  (3.2.10)  to  (3.2.3),  and 

the  scalar  Lagrangian  multiplier  rj  adjoins  the  evader’s 

target  constraint  (3.2.8)  to  (3.2.1).  In  terms  of  the 

differential  endgame’s  constrained  payoff  functional,  the 

differential  endgame  is  mathematically  expressed  as 

2 

Min  Max J  Min  Max/a_r  (T  }  (T  )].A.A[x  (T  )_x  (T 
uSU  v(EV  c  uGU  vGV(2  L  pWl;  Xe'‘il'J  A  ALXp'“il'  x.et‘il;j 

T1 

+  f  [l/2u’R  (t)u-l/2v’R  (t)v+A  ’(F  (t)x  +G  (t)u+n  -x  ) 
v  d  e  d  o  P  P  DO 


P  P 


+  Ae,(Fe(t)xe+Ge(t)v+n.e-xe]dt+»7/2(xe2(T2)’xe2(T2)-V/) 


+  /x,Cxe(T2)4>e(T2,Ti)Xe(Ti)] 

T2 

-  J  Cl/2v’Re(t)v+^’§e(T2,t)(Ge(t)v+ne)]dtj>  (3.2.11) 
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3.3  DETERMINATION  OF  THE  EULER-LAGRANGE  EQUATIONS 
FOR  THE  DIFFERENTIAL  ENDGAME 

Applying  variations,  8u  and  §v,  about  a  particular 
pair  of  controls,  u  and  v,the  total  variation  of  the  dif¬ 
ferential  endgame's  constrained  payoff  functional  Jc  is 

AJ=[a2  (x  (T,  )-x  (T.  ) ) '  A'  A-A  '  (Tn)3Sx  (T..  ) 
c  pi.  el  pl  Pi 

+  Ca2(xe(T1)-XD(T1))A'A-Ae'  )-/z'C|)e(T2  35x^1^) 

+  [/x,Q,+r)xe?(T2)'35xe2  (T2) 

T1 

+  f  [(u'R  (t)+A  ’G  (t) )§u+(-v'R  (t)+  A  ' G  (t)  )5v 
•L  *•  p  PP  e  ee 

x0 

+  (A  '  +A  '  F  (t ) )5x  +( A-  '  +Ae'  Fe.(t )  )§x  ]  dt 

ppp  peee-  e 

T 

-  f  2[v'Re(t)  +  /i'§e(T2,t)Ge(t)]5v  dt 
T1 

+a2/2[5xp(T1)-Sxe(T1)3,A,ACSxp(T1)-5xe(T1)3 


+  J?/2Sxe2(T2)'5xe2(T2) 


f 

+1/2-  J  1[Su' :Sv' 3 


■R  (t)  0 


0  -Re(f)JL§vJ 


rSua 


dt-l/2  J  ^v'Re(t)Sv  dt  (3.3.1) 


From  AJc  the  necessary  and  sufficient  conditions  for 
the  existence  of  a  saddle  point  for  the  differential  end¬ 
game's  payoff  functional  are  determined.  Of  primary 
interest  are  the  necessary  conditions  v?hich  result  in  the 
determination  of  the  Euler-Lagrange  equations  and  their 
.  associated  boundary  conditions.  These  necessary  conditions 
are  derived  by  requiring  the  first  order  variations  of  AJc 
to  vanish.  Table  1  summarizes  these  necessary  conditions. 


o 


o 


*the  (3x1)  partitioned  vector,  is  obtained  by  pre- 

mult  iplying  the  (6x1)  vector,  n ,  by  the  matrix  Q. 
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The  complete  set  of  Euler-Lagrange  equations  is  formed 
by  combining  the  differential  constraints  of  the  partic¬ 
ipants  (3.2.3)  and  (3.2.4)  with  the  necessary  conditions 
(3. 3. 2-3. 3. 6).  The  boundary  conditions  for  the  unknown  vari¬ 
ables  of  the  Euler- Lagrange  equations  are  formed  by  combining 
the  known  boundary  conditions ( 3 . 2 . 5-3 . 2 . 8 )  with  the  necessary 
conditions  ( 3 . 3 . 7-3 . 3 . 9 ) .  Therefore  the  Euler-Lagrange 
equations  are: 


x. 


X, 


Fp(t) 


0  Fe(t) 
0  0 

0  0 


-G  (t)R  (tT^G. ' (t) 
P  P  P 


-v(t) 


0 


Ge(t)Re1(t)Ge'  (t) 


-Fe’ (t) 


P 

*e 

A„ 


+ 


n 

P 
n  e 
0 
0 


for 


(3.3.10) 


x  =F  ( t ) x  -G  (t)R~1(t)G  J  (t)C6'(T9,t)/i  +n.  ;  for 


e  e 


e  e 


*e  i 


Tx<t^T2  .  (3.3.11) 

The  boundary  conditions  for  the  state  vectors,  x^  and  x£ ,  the 

costate  vectors,  A  and  A  ,  in  terms  of  the  constant  costate 

p  e 

vector  n  and  the  scalar  Lagrangian  multiplier  r)  are: 


PpIV-I 

‘!pol 

(3.3.12) 

Lxe<t0)J 

1 

X 

fl> 

o 

1 — 

xel(T2)  = 

0 

(3.3.13) 

i>xe2CT2) 

=  -J*2 

(3.3.14) 

W  * 

a2A' A[x  (T. )-xe(T.  )] 
pi  el 

(3.3.15) 

Xe(T1)+a2A'A[xD(T1)-xe(T1)]+Cpel(T2ST1)  /*  =  0  (3.3.16) 


xe2  (T2J 'xe2(jV  =  VT 


(3.3.17) 


The  simultaneous  solution  of  these  linear  differential 

equations  and  their  nonlinear  algebraic  set  of  boundary 

equations  yields  the  costate  vectors  X  5  X  .  and  /<>  and 

P  e  . 

the  scalar  Lagrangian  multiplier  tj  .  With  the  determination 
of  these  Lagrangian  multipliers  the  optimal  strategies  for 

i 

the  participants  and  the  differential  endgame’s  value  can 
be  determined . 

3.4  SOLUTION  OF  THE  EULER- LAGRANGE  EQUATIONS 

The  solution  for  the  costate  vectors  of  the  Euler- 


Lagrange  equations  (3.3.10)  defined  over  the  engagement 


interval  [tQ,  T^]  is 


kk  "  (T1,t)XJc(Ti);  k  =  p,e  (3.4.1) 

where  (T^ ,t)  are  the  transition  matrices  for  the  costate 

vectors,  X  and  \  ,  and  X..(T,  )  and  X-(Tn  )  are  the  unknown 
costate  vectors’  corner  conditions.  The  participants’ 
state  vectors  at  T^  in  terms  of  the  corner  condition 


vectors  are: 


Wl  l&<Ti>v 


Wj  I  °  ^WJ  K<V 


,<‘04 


>ip<ti)"i  rkp<Ti’to> 


'WV 


0  M.e(T^,tg)J  L^e(Tl'j  [ke(Tl’t0) 
where  the  controllability  matrices  are  defined  as 


(3.4.2) 


r.  , 

K  k(  T  ,  t  )  =  r  ^  Tr  t )  G  k(  t )  R  k(  t )  G \J.  t  %(  T,  ,  t )  dt :  k= p ,  e  (3.4.3) 
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and  the  6x1  column  vectors  k.  (T, ,trt)  due  to  the  disturbance 

X  U 


vectors  n,.  are 
k  T. 


kk^Tl >V  =  J  ^K^Tl>1:^nkd1 


k=p,e 


(3.4.4) 


The  solution  of  the  Euler-Lagrange  equation  C 3. 3.11) 
defined  at  t='i2  in  terms  of  the  unknown  costate  vector  /x 
and  the  evaders  unknown  terminal  engagement  state  x0(T1)  is 
xe(T2)=4(T25T1)xe(T1)-He(T2)T1)M+ke(T2)T1)  (3.4.5) 

where  the  6x6  controllability  matrix  is  defined  as 


r  2  n 

Me(T25T1)=  J  §e(T2,t)Ge(t)Re(t)"1G^(t)6e'Q,2}t)dt  (3.4.6) 


and  the  6x1  column  vector  ke(T2,T^)  due  to  the  distur¬ 


bance  vector  ne.  is 


T 

WV'  /WV^V* 


(3.4.7) 


X1 

Therefore,  by  solving  for  the  unknown  corner  condition 
vectors ,  Ap(T^)  and  X^T^and  the  costate  vector  n  ,  the  solu- 
tion  of  the  Euler-Lagrange  equations  are  obtained. 

3.4.1  Determination  of  the  Costate  Vectors' 

Corner  Conditions 

With  the  use  of  the  evader's  boundary  condition 


■1/tj  f.i? 


(3.4.8) 


The  costate  vector  /x  is  expressed  in  terms  of  the  evader's 
unknown  terminal  engagement  state  xe(T^)  and  the  unknown 
Lagrangian  multiplier  r\  as: 
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O 


O 


vj 


/<=CMe(T2,T1)-l/j)Q'Q]"^e(T2,T1)xe(T1)+ke(T2;T1)[  (3.  >1.9) 


Substituting  for  X£(T^)  V  be  comes,  in  terms  of  the 

evader's  corner  condition  costate  vector  X  (Tn )  and  the 

e  i 

scalar  Lagrangian  multiplier  77 ; 
/<=[Me(T2>T1)-l/,Q'Qr1|0)e(T2,t0)xeCt0)  + 

4(T2tT1)Me(T1,t0UeCT1>-s(pe(T2,T1)ke(T1,t0)+kefT2,T1)J(3.4.10) 
Substituting  the -unknown  vectors-  x  (T.  ) 3  x  (T, )  and  pi 

6  X  p  1 

given  by  (3.4.2)  and  (3.4.10)  into  the  corner  condition 
equations  (3.3.1553.3.16)  the  unknown  variables  in  the 
corner  condition  equations  are  reduced  to  Xg(T^) 

and  77  .  The  corner  conditions  become 


U+a2A»AMg(T1  ,t0)l  a?A,AMe(T1,t0) 
-a2A'AMp(Tl3t0)  |  U-Ca2A«A-K(J7)]Me(T1,t0) 


1(T,  ) 

P  1 


a2A'A  I  -a2A' A 


-a2A'A  |  a2A'A  -K(>? ) 


K  <Ti>V 


.P. 

CeUl,w0' 


k_  (T.,  3tn) 


4(Ti»V  0 


I  «- 


^e(Tl,1:0] 


W 


XP<V 

xe(V 


K(7?4>e(T13T2)ke(T2,T1) 

where  the  matrix  K'(r])  is  defined  as 
K(i7)=^(T2,T1)  CHe(T23T1)-l/77Q'Q]--\5e(T23T1) 

In  shorthand  form  (3.4.11)  is  rewritten  as 
B(J?)X(T1)=  C(J?)x(t0)+j!(7?) 


(3.4.11) 


(3.4.12) 


(3.4.13) 


The  corner  condition  costate  vectors  Ap(T^)  and  Xe(T^)  are 
determined  as  functions  of  the  unknown  parameter  rj  as 


Xe(T1)  =  CO!U3B(77)“1  (  C(r?)x(t0)+A/(>))) 


(3.4.14) 


P 
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X;(^1)  =  [U{0]B(r?)~r‘(C(r})x(t0)+Jf(J?))  (3.4.15) 

where  the  order  of  the  null  and  identity  matrices  are  6x6 
for  the  three  dimensional  coordinate  system. 

Substituting  (3.4.12)  and  (3.4.14)  into  (3.4.10)  the 
costate  vector  fi  is  expressed  in  terms  of  the  parameter  V 
as 

^s<!>e(T l’V  K<-7>tMe(Ti>to)C°!u:iB(^)"1  (C(rj)x(t0)+j(T/)) 
+^Tl‘t0)xe  (t0)+ke(Tl5t0)'f<:S>e(Ti’T2)ke(T2  >V3  (3.4.16) 


The  parameter  tj  is  determined  by  substituting  the  evader’s 
target  boundary  condition  (3.4.8)  into  the  evader's  kinetic 
energy  target  constraint  (3.2.8). 

i 

xe2(T2),Xe2(T2)  =  1/7}*  ^  (3.4.17) 

By  substituting  /x  (3.4.16)  into  (3.4.17)  the  evader's  target 
kinetic  energy  constraint  (3.4.17)  is  expressed  in  terms  of 
the  scalar  multiplier  7)  . 


1/tjVq'Q/x-Vj2  =  ^  = 


(3.4.18) 


The  value  for_7j  is  determined  by  extracting  the  roots  of 
(3.4.18). 

Equation  (3.4.18)  represents  an  exact  polynomial.  L 

depends  on  the  weighting  matrices,  R  (t)  and  R  (t),  and  the 

p  e 

matrices,  Fj,(t),  ( t ) ;  k=p,e9  defining  the  dynamics  of 

the  participants. 

In  the  Appendix  8.1.5  it  is  shown  that  when 


(3.4.19) 
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(3.4.20) 


LUJ 

Rk(t)  =  rkCU];  k=P>e  (3.4.21) 

the  degree  of  the  polynomial  (3.4.18)  expressing  the 
evader's  kinetic  energy  constraint  is  six. 

3.4.2  Determination  of  the  Control  Algorithms 
for  the  Pursuer  and  the  Evader 
From  the  necessary  conditions  (3.3.2,  3.3.3)  requiring 
8 Jc  to  vanish  the  open  loop  optimal  strategies  for  both  the 
pursuer  and  the  evader  over  the  engagement  time  interval 
are : 


V*=R  "1(t)G'(t)  <$>'(T,  ,t)  A  (T,  )  (3.4.22) 

e  e  e  1  el 

U*=-Rp”1(t)6p(t)  ^'(T15t)  A  (Tx)  (3.4.23) 

Substituting  the  known  corner  condition  vectors 
(3.4.14)  and  (3.4.15)  into  (3.4.22,  3.4.23),  the  control 
algorithms  for  the  participants  over  the  engagement  interval 
are  j 

v*  =  R“-kt )G^(t)  (fKT-^t)  C0;u]B()?)"1(c(J7)x(t0)  +  i)(ry))  (-3-.-4.24) 
u  *  =-R“1(t)Gp(t)  <]pp'(T1,t)  [U|0]B(J7)"1(c(>7)x(t0)  +  J?(7?))  (3.4.25) 


These  time-varying  optimal  strategies  are  functions  of  the 
initial  state  and  initial  parameters  of  the  endgame. 

The  evader's  optimal  strategy  over  the  postengagement 
interval  is  derived  from  one  of  the  necessary  conditions 
(3.3.4).  requiring  8 to  vanish.  This  strategy  is  expressed 
as 

*=  -Re(t)"1Ge'(t)d)e'(T2,t)/i 


v 


(3.4.26) 
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Substituting  for  [l  ,  given  by  (3.4.9),  (3.4.26)  becomes 
v*=  -Re(t)"1Ge'(tXf'e,(T2,t)0'  CT1,T2)K(17)X 

[xe(T1)+§e(T1,T2)ke(T2,T1)D  (3.4.27) 

where  the  evader's  state  vector  x  (T. )  is  considered  as 

e  1 

the  evader's  initial  state  vector  to  be  measured  during  the 
postengagement  interval.  The  scalar  multiplier  r)  is 
determined  by  substituting  the  vector  /x  ,  defined  by 
(3.4.9)  into  the  evader's  terminal  kinetic  energy  constraint 
(3.4.17). 

These  strategies  do  not  take  into  account  errors 
such  as  noise  from  radar  measurements  and  the  approximations 
of  the  exact  dynamics  of  the  participants.  The  uncer¬ 
tainties  due  to  these  errors  during  the  endgame's  duration 
can  be  reduced  by  continuously  measuring  the  initial  state 
of  the  participants  and  updating  the  initial  parameters  of 
the  differential  endgame. 

3.5  NECESSARY  AND  SUFFICIENT  CONDITIONS 
FOR  THE  DIFFERENTIAL  ENDGAME 

The  necessary  conditions  that  must  be  satisfied  over 
the  differential  endgame's  time  interval,  CtQ,T23,if  the 
payoff  functional,  J,  defined  by  (3.2.1)  has  a  saddle 
point  for  the  strategies  ,u=u*  and  v=v*  are: 

1)  The  Euler-Lagrange  equations  and  their  boundary  con¬ 
ditions  must  be  satisfied  when  the  first  order  vari¬ 
ation  of  A<Jc  is  equated  to  zero.  This  has  been  pre¬ 
viously  accomplished  in  Section  3.2. 
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2)  An  analogous  Legendre-Clebsch  condition  for  the  saddle 
point  must  be  satisfied  over  the  time  interval  of  the 
differential  endgame. 

3)  Nonexistence  of  a  conjugate  point  for  the  accessory 
minimax  problem  over  the  time  duration  of  the  differen¬ 
tial  endgame  must  be  shown. 

If  J  has  a  saddle  point  for  the  control  strategies* 
u  =.u*  and  v  =  v*,  then  the  three  previous  necessary 
conditions  are  sufficient  if  they  are  satisfied  simulta¬ 
neously. 

3.5.1  Analogous  Legendr e-Clebsch  Conditions  for 
the  Differential  Endgame 

With  reference  to  the  variation  of  the  constrained 

payoff  functional  (3.3.1),  when  the  first  order  variation 

SJ  vanishes,  AJ  becomes 
c  c 

52Jc=a2/2[Sxp(T1)-5xe(T1)],A'AC5xD(T1)-5xe(T1)]+ 

T 

7l/2  8x  9  (T9 ) 1 8x  9(T9)  +  l/2  f18  u'R  (t)Sudt 

oi  l  o2  L  J  p 


-1/2 


/ 


8v* R  '(t ) 5vdt 


(3.5.1) 


Another  necessary  condition  for  J  to  have  a  saddle  point 
with  respect  to  the  control  strategies  (u,  v)  is  that  the 
second  order  variational  terms  with  respect  to  Su  must  be 
nonnegative  and  the  second  order  variational  terms  with 
respect  to  8v  must  be  nonpositive.  These  conditions  are 
satisfied  if 
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R  (t)  >  0 
P 

P.,(t)  >  0 


(3.5.2) 

(3.5.3) 


These  conditions  are  analogous  to  the  one-sided  optimiza¬ 
tion  problem  (13). 

3.5.2  Conjugate  Point  Problem 

The  final  necessary  condition  for  the  existence  of  a 
saddle  point  (u* ,v* )  is  the  nonexistence  of  a  conjugate 
point  for  the  accessory  minimax  problem  of  the  differential 
endgame . 

3. 5. 2.1  Accessory  Minimax  Problem 

2 

The  accessory  minimax  problem  is  ^  ^c  = 

M^{a2/2[SXp(Ti)-SXe(T1)],A'A[6xp(T1)-Sxe(T1)3 

+  *)/2Sxe(T2)'Q'Q8xe(T2) 


-T,  r 

R  (t)  0  J8 

u~ 

+  1/2 

j  1[8u'l  Sv'  ] 

P0  -Re.(t)Jjs 

~  dt 

VJ 

-1/2  J  Sv'R  (t)Svdt4 

T  6  ' 

*1 

subject  to  the  constraints 

8x  =F  (t)5x  +G  (t)5u 
P  P  P  P 

6xe=Fe(t)8xe+Ge(t)8v;  tQ  ^  t  ^  T^ 

T 

^e(T2)=<^e(T2,Tl)Sxe(Tl)+  /"  2<$’e(T2  ,t)Ge  (t )§V; 


Tx  <  t  <  T2 


5W 


(3.5.5) 


5xe(t0) 


(3.5.6) 

(3.5.7) 


(3.5.8) 

(3.5.9) 
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Sxel(T2)  =  0  (3.5.10) 

xe(T2)Q'Q5xe(T2)  =  0  (3.5.11) 

where  the  payoff  functional  for  the  accessory  minimax 
problem  is  the  second  order  variation  of  the  differential 
endgame's  constrained  payoff  functional  (3.2.11);  the  dif¬ 
ferential  constraints  (3.5.6,  3.5.7)  and  the  integral 
constraint  (3.5.8)  represent  the  perturbated  dynamics  of 
the  participants,  due  to  the  variationals  Su  and  Sv;  the 
boundary  condition  constraints  (3.5.9-3.5.11)  represent 
the  perturbated  boundary  and  target  constraints  due  to  the 
variationals  Su  and  Sv. 


If  the  solution  of  the  Euler-Lagrange  equations  that 

Min  iT 

results  from  gu  g^  c  does  not  vanish,  then  the  non¬ 
existence  of  a  conjugate  point  is  assured. 

2 

Adjoining  to  8  Jc,t'ne  differential  constraints, 

(3.5.6,  3.5.7)  by  SAp  and  SAe,  the  integral  constraint 
(3.5.8)  by  S/z, and  the  target  constraint  (3.5.11)  by  §7?, 
the  accessory  minimax  problem  becomes 

ViSn  M|^2/2[Sxp(Tr)-Sxe(T1)]'A'A[Sxp(T1)-Sxe(T1)] 

+  V 2 Sxe  (T2 ) '  Q '  QSxe  (T2-)  +8r)xe  (T2 ) '  Q '  QSxp  (T2 ) 

T 

+  /  (  l/2$u'R  (t)8u-l/2Sv'R  (t)Sv+SX  ’  (F(t)8x  +G(t)8u-Sx) 

•L  '  p  e  p  p  p  p 

0 

+  B\e'  CFe(i)8xe*GQ(t)8v-8xe  ))dt + 5  /x’  ( Sxe  ( T2 )  -<J>e(  ?2 ,  )  Sx£  ( ?1 ) ) 


2 

-  /  (l/2Sv'Re(t)Sv-i-f>e(T2,t)Ge(t)Sv)dt| 


(3.5.12) 
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Applying  variational  calculus  to  (3.5.12)  the  varia- 
o 

tion  of  8  J  is 

A (S2J  )  =  S(82J  )+...+  (3.5.13) 

c  c 

2  9 

where  8(8  J  )  is  the  first  order  variation  of  S'J  .  A 
c  c 

necessary  condition  required  for  the  existence  of  a  saddle 

2 

point  for  8  Jc  is 

8(82J  )  =  0  (3.5.14) 

The  necessary  conditions  satisfying  (3.5.14)  are  in 

Table  2. 


3. 5. 2. 2  Solution  of  the  Accessory  Minimax  Problem 

Before  proceeding  to'  establish  the  test  for  the 
existence  of  a  conjugate  point  it  is  necessary  to  eliminate 
the  unknown  costate  vector  8 M  from  the  corner  condition 
equations  (3.5.22)  and  (3.5.23).  With  the  aid  of  the  neces¬ 
sary  condition  (3.5.19)  defining  the  optimal  control  §v 
over  the  interval  (T15T2],  and  the  integral  constraint 
(3.5.8)  the  boundary  condition  for  Sx£(t)  is  written  as 


Sxe(T2  )=* 


Sv/yXe  2<T2> 


<4<T2"Tl,Sxe(V 


-Me(T2,T1)S(t 
Solving  for  S/x 


S/x=[Me(T2}^)-l/J7Q'Q]“1j<|)e(T2,T1)Sxe(T1) 
0 

i/nxe2(T2)j- ) 


+617 


(3.5.15) 


(3.5.16) 


Substituting  ■  S/z  in  the  corner  condition  equations  (3.5.22- 
3.5.23)  the  corner  condi cions  become: 


34 


Table  2 

2 

Necessary  Conditions  for  8(8  J )  to  Vanish 


Varia¬ 
tional  Coefficients  of  Variationals  Equated  to  Zero 


S(8u) 

Rj  (t)8u+Gp'  (t)SXD=0 

(3. 5. 17) 

8(§v) 

-Re(t)8v+Ge' (t)5Xe  =  0;  t Q^t=T;L 

.-Re  (t)Sv-Gg  (t )  (|>g(T2,t)  Sfx='->» 

T.<t^T2 

(3.5.18) 

(3.5.19) 

S(8x  ) 

8An  1  +  8A_ ' F  ( t )  =  0 

(3.5.20) 

.  .  P.. 

P  P  P 

8(8xe) 

SAe'  +SAg  Fe  ( t )  =  0 

(3.5.21) 

8(5xd(T1)  ) 

-5A  ' (T,  )+a2[8x  (T. )-£x  (T, )]' 
pi  p  1  e  ± 

1 A '  A=  0 

(3.5.22  ) 

8(5xe(T1)  ) 

-  8A  (T,  ) 1  -a2  [8x  (T»  )-Sx  (T, )]' 
e  l  pi  el 

'A' A 

-V§e(T2>Tl)s0  (3.5.23) 


5  (Sxe2  <T2 ) )  v8xq2  (T2  )+S7?xe 2  (T.2  )  +  5/z2=  0 


(3.5.24) 


1  [-a  A'A,  a  A'A-<£>e'  (T2  ,T, )  [Me(T2  ,T1)-1/»J  Q'  Q]<&e(T2  jTjj&cCT,) 


(3.5.25) 


where  SACT,)  and  8x(T,)  are  defined  as 

[syv 

XWm  \  -  P  X 


8  ACT,)  =  *  x 

-  1  5  A  ( T,  ) 

e  1 


■  5x(Tx)  = 


SXp(Ti) 

Sxe(Ti) 


(3.5.26) 


(3.5.27) 


From  the  corner  condition  equations  (3.5.25)  one  can  solve 

for  the  unknown  corner  condition  of  the  costate  vectors, 

SApCT^)  and  SAe(T,),  and  the  constant  costate  vector  8n  in 

terms  of  the  unknown  state  vectors, 8x(T, ) ‘ana  8x  (T, ). 

’pi  el 

Now  specifying  the  free  unknowns  Sx^CT^);  k  =  p ,  e  ,  as  nu, 
the  system  of  the  free  unknowns,  X(T, )  is 


X(T1)  =  [m,.  .  .  mn]  = 


(3.5.28) 


system  of  the  corner  condition  costate  vectors  A(T,) 


ACT-,)  =i 


a2A'A 

-a2A’A 


-a2A'A 

Ca2A'A-K07)] 


(3.5.29) 


where  the  matrix  C  is  composed  of  the  number  of  column 
vectors  equal  to  the  number  of  free  unknown  column  vectors 
m,.  These  column  vectors  which  are  partitioned  into  two 


6x1  column  vectors  are  defined  as: 
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ci 


l$\§e'  CT2  ,T2 )  CHe  (T2  ,T2  )-l/r)  Q«  Q]"1  [l7? j 


(3.5.30) 


Substituting  the  nu  vectors  into  (3.5.16)  the  system  of 
costate  vectors  composed  of  S/*.  becomes 


M  =  (j>  '  (T,  ,T9)[K (>?)+C] 


(3.5.31) 


'e  "l*  2' 

Now  for  the  accessory  minimax  problem,  the  system  of  Euler- 
Lagrange  equations  over  the  engagement  time  interval 
[tQ,^]  is 

.  .  ... 

0 

J  P 

0 


X 


* 

A 


"F  ( t )  0  -G(t)R  .(t)"3^'  (t) 

P  P  P  P 


0  Fe(t) 


0  0 
0  0 


Ge(t)R‘1(t)6g(t) 


-F  ‘ (t ) 


0 


-Fe* (t) 


(3.5.32) 


A 


subject  to  the  boundary  conditions  X(T^)  and  A(T1),  defined 
by  (3.5.28)  and  (3.5.29).  The  solution  of  the  Euler- 
Lagrange  equations  over  the  engagement  time  interval  is 


X(t) 


A(t ) 


0 

0 


0  0 

0  ^(t.Tp  0 

0  •  ^'(t,^)  0 

-0  0  ^(t,Tij 


0 

0 


U  0  M  (T1>to) 


0  u 


-Me(Ti,t0) 


X(TX) 


(3.5.33) 


A(T1) 


0  0  U  0 

0  0  0  U 

Substituting  the  corner  condition  equations  (3.5.28, 
3.5.29)  into  (3.5.33) 
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XCt) 


0  0>  (t5Tn ) 

■‘e  1 


Hp(Tl5t0> 


0  fa  A'A 


■2a'A  -a2A'A 


A  a  A'A-K(t? 


+■  <  +  <  T 
0  X  ^1 


(3.5.34) 


As  shovm  by  (3.5.30)  the  matrix  C  is  a  function  of  the 
unknown  scalar  Lagrangian  multipliers  Sr].,.  8r 7^  is  determined 
as  follows:  substituting  Sx  (T0)  obtained  from  the  neces- 
sary  condition  (3.5.24)  into  the  target  constraint  (3.5.11) 
one  obtains 

57Jxe2(T2)'Xe2<T2)  =  "xe  2  <T2  } '  Sfi2  (3.5.35) 

Substituting  for  S/^2,  (3.5.35)  becomes 

^xe2  (T2  ^  *  xe2  ^T2  ^  =  ~Xe2  ^T2  ^  '  (T1  >T2  )Sxe  (T1} 

-  Sn/rj^j  (T;)  ,T2)K(??)<Pe(T1,T2)xe(T2)  (3.5.36) 

Solving  for  8rj  and  using  the  terminal  kinetic  energy 
constraint 


-xe2(T2)'QC5e'  (T1,T2)K(7j)8xe(T1) 

VT2+l/r)  Qf^l  (Tx  ,T2)K(>j  ,T2  )xg(T2  ) 

Now  for  each  selection  of  the  column  vector  m^ 

-xe2(T2),Q<iV  (Tl»T2)K(7,)mi 

5rji  =  V^W^i'^2 )K(v5  }^T1  ’T2  )xe  (T2  } 


(3.5.37) 


(3.5.38) 


Over  the  postengagement  interval  X  (t)  is  defined  as 


Xe(t)  =  cl)e(T2,t)  -  Me(t,T1)M 


(3.5.39) 
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3.5.2. 3  Conditions  for  Nonexistence  of  a  Conjugate  Point 
The  solution  of  the  Euler-Lagrange  equations  X(t)  for 
the  accessory  minimax  problem  does  not  vanish,  and  con¬ 
sequently  no  conjugate  points  exist,  if 


1 

u  + 

’yw  ° 

/ 

( 

a2A'A  -a2A‘A 

o  n 

•c) 

0  -MeCTi;t0) 

V 

-a^A'A  a  A'A-K(^) 

/ 

« 

*  °,  t04t4Tl  (3.5.40) 

detj  d>e(T2,t)+He(t,T1)M|  t  0,  T]L<  t  <  T2  (3.5.41) 

3.6  EXAMPLE  OF  A  DIFFERENTIAL  ENDGAME 


Here  the  framework  of  the  differential  endgame  is 
defined  by  specifying  the  dynamics  of  the  pursuer  and 
evader  and  their  weighting  matrices, R^Ct)  and  R0(t)  .  For 
this  particular  differential  endgame,  which  was  programmed 
on  the  digital  computer,  the  dynamics  of  the  participants 
both  have  the  identical  form: 


'kl 


k2 


0  U 
0  0 


x 


kl 


x 


k2 


uk(t)  + 


*ki<y 

xik(t0>. 

X 


klO  • 


;  k=p,e 


0 

*.  \  k=p,e  (3.6.1) 
0 
L32 


(3.6.2) 


k2  0 


The  partitioned  (3x1)  state  vectors,  x^  and  xk2,  represent 
the  position  and  velocity  vectors  of  the  participants 
respectively.  The  components  of  ”'ne  (6x1)  disturbance 
vectors, n  and  nv represent  the  acceleration  of  gravity. 
The  weighting  matrices  are  diagonal  ones  of  the  form 
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Rk  =  rk  [U] ;  k  =  p,e 

3.6.1  Control  Algorithms  for  the  Participants 


(3.6.3) 


The  control  algorithms  for  the  participants  of  this 
endgame  are  specifically  formulated  as  follows.  For  the 
pursuer  the  components  of  the  (3x1)  control  force  are 

uj(t)=  -TixPij  ri)/rPj+,:Vj<Ti>/rpj)ti  *0  4 1  s  A  <3-6-4) 


For  the  evader  the  control  components  are 


v  (t)_  (TlXelj(Tl)+Xe2j(Tl))/rej"(;elj(Tl)/rej)t;  *0“  t"  T1 

j  “(Vij+V/rej  +  (Vrej)t5  T!  <  t  ^  T2 


j  =  1,3 


(3.6.5) 


The  components  of  the  corner  condition  costate  vectors, 
Ap(T^)  and  A£(T^)  ,ana  of  the  costate  vector /x  which  are 
defined  by  (3.4.14)  and  (3.4.15)  are  explicitly  formulated 
in  the  Appendix  8.1. 

3.6.2  Determination  of  the  Lagrangian  Multiplier  . rj  . 

With  reference  to  the  boundary  condition  (3.4.17)  the 
target  kinetic  energy  constraint  is  expressed  in  terms  of 
the  (3x1)  partitioned  costate  vector  /x  In  Appendix  8.1.5 
the  components  of  this  partitioned  costate  vector  are 
rational  fractional  polynomials  in  terms  of  Lagrangian 
multiplier  r\  .  Thus  the  scalar  product  of  /x2  with  itself 
yields  a  sixth  order  polynomial  function  of  rj . 

Because  of  the  degree  of  this  polynomial is  greater 
than  one,  it  appears  that  the  existence  of  multiple  values 
of  r)  would  cause  great  difficulty  in  determining  the  true 
saddle  point  for  the  differential  endgame.  But,  fortunately 
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this  polynomial  generates  one  root  which  can  be  used 
for  the  determination  of  a  saddle  point.  In  the  numerous 
cases  of  differential  endgames  that  were  simulated  on  the 
digital  computer  four  of  the  roots  of  the  rj  dependent  poly¬ 
nomial  were  always  complex.  Of  the  two  real  roots,  there 
results  the  evader5 s  target  velocities  which  are  of  the 
same  magnitude  but  of  opposite  direction.  Thus  from  a 
physical  viewpoint  one  of  the  real  roots  is  meaningless 
for  it  assumes  that  the  evader  can  reverse  its  direction 
during  the  postengagement  period. 

3.6.3  Differential  Endgame  Simulated  on  the 
Digital  Computer 

For  this  particular  differential  endgame  the  initial 
state  of  the  participants  are 


vv  = 


"50000.  (ft) 

‘150000. (ft) 

1000. 

5000. 

70000. 

;  xe(tQ)  = 

90000. 

7000. (ft/sec) 

-  100. 

-10000. (ft/sec) 
100. 

50. 

200. 

(3.6.6) 


The  other  parameters  of  the  endgame  are:  the  terminal 

engagement  time,  T^, is  6.4  seconds;  the  target  time,  T2 ,  is 

20.7  seconds;  the  evader's  target  speed  is  9000  ft/sec; 

2 

the  weighting  coefficient,  a  ,  is  1;  the  evader's  weighting 

matrix,  Re (t)  is  60 [If]  and  the  pursuer's  weighting  matrix 

R  (t)  is  r  CU] ;  1  <r  1  120.  For  these  weighting  matrices 
o  p  p”  ^ 

the  participants'  controllability  matrices  satisfy  the 
following  relationship 


V  f  rp  4-  \ 

*  ^  ^  0  * 


/•„  w  ('V  t-  } 

up'  ie;“p'"l’  '0' 


(3.6.7) 
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where  (r  /r  )  is  called  the  evader's  controllability  factor, 
p  e 

The  effect  of  the  controllability  factor  upon  the  terminal 
engagement  miss  distance  and  the  participants’  maximum 
control  accelerations  are  studied. 

Figure  1  shows  how  the  terminal  miss  distance  increases 
with  an  increase  in  the  evader’s  controllability  factor. 

From  Figure  1  one  can  relate  the  evader’s  controllability 
factor  to  the  intercept  capability  of  the  pursuer's  war¬ 
head.  For  this  differential  endgame  the  evader  can  be 
intercepted  regardless  of  the  evader's  controllability 
factor  if  a  nuclear  warhead  is  used  (16). 

Figure  2  illustrates  how  the  participants’  maximum 
control  accelerations  vary  wixh  respect  to  the  evader's 
controllability  factor  for  this  particular  differential 
endgame.  The  pursuer's  maximum  control  acceleration  occurs 
at  the  commencement  of  the  differential  endgame.  'The 
evader's  maximum  control  acceleration  occurs  at  the 
terminal  engagement  time.  From  Figure  2  the  participants' 
control  capability  can  be  related  to  the  structural  design 
of  the  participants'  airframes. 


Evader's  Controllabili 
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3.7  SUMMARY  OF  THE  CHAPTER 

The  principal  contributions  contained  in  this  chapter 

are : 

1.  Formulation  of  the  terminal  endgame  between  an  offensive 
missile  and  its  pursuer  within  the  framework  of  dif¬ 
ferential  game  theory. 

2.  Determination  of  the  necessary  and  the  sufficient 
conditions  for  the  existence  of  a  saddle  point  for 
the  differential  endgame  problem. 

3.  Determination  of  optimal  open  loop  strategies  for  the 
participants  of  the  differential  endgame. 

4.  Through  an  example  it  is  illustrated  how  the  dif¬ 
ferential  endgame  can  be  used  in  determining  certain 
design  specifications  such  as  structural  capability 
and  the  pursuer’s  warhead. 
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4.  PARAMETER  OPTIMIZATION  FOR  DIFFERENTIAL  GAMES 

4 . 1  INTRODUCTION 

For  the  differential  endgame  studied  in  Chapter  3  the 
pursuer's  initial  state  vector*  the  intercept  time,  and  the 
target  time  arc  fixed  values.  Now  it  is  proposed  to  study 
the  differential  endgame  whose  intercept  time,  target  time, 
and  pursuer's  initial  state  vector  are  unknown.  Here  the 
relationships  that  determine  these  unknown  parameters  are 
derived. 

For  the  class  of  differential  games  studied,  by  Ho 
et  al  (  6  ),  the  pursuer's  initial  state  vector  and  terminal 
engagement  time  are  fixed  values.  This  class  of  dif¬ 
ferential  games  is  formulated  where  the  pursuer's  initial 
state  vector  and  the  terminal  engagement  time  are  unknown. 

The  relationships  that  determine  these  unknown  param¬ 
eters  are  derived. 


For  the  differential  game  it  is  shown  how  the  deter¬ 
mination  of  the  intercept  time  and  the  pursuer's  initial 
state  via  differential  game  theory  is  used  to  determine 
when  the  pursuer  is  launched. 

4.2  PARAMETER  OPTIMIZATION  FOR  THE  DIFFERENTIAL  ENDGAME 


For  the  participants'  optimal  strategies,  .u* 

and  v*,  and  the  differential  endgame's  payoff  functional 

J  =  a2/2 [x  (T,)-x  (T. )]'A'A[x  (T.. )-x  (T1 )3 
plel  plel 


T1 

+1/2  f  u'R  (t)udt-l/2 
J  D 


f  v'R  (t)vdt 
'L  e 

L  n 

v/ 


(4.2.1) 


(4.2.2) 
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subject  to  the  constraints 


x  =F_ (t)x  +G  (t )u+n 
P  P  P  P  P 


e  e  e  e  e 


(4.2.3) 

(4.2.4) 

(4.2.5) 

(4.2.6) 

(4.2.7) 

(4.2.8) 

0 

u,v£Ra  (4.2.9) 

determine  the  differential  endgame’s  parameters,  ,  T£, 
and  x  (tg)  such  that  W(xp(tQ),  xe(tQ),  tQ),  the  value  of 
the  differential  endgame,  is  determined  by 


xe^t0)=xe0 

*pi(to)'V<,»)=Eo 

xp2^t0^  'xp2^1:0^=V0 

xel<T2>=° 

xe2CT2>'xe2(T2)=V 


W(x  (t  )  x  (t  )  t  )  =  ^ 

"Uplt0;,xeU0i,T0;  u£U  vCV 


(4.2.10) 


subject  to  the  constraints  (4 . 2 . 2-4 . 2 . 9) . 

The  state  vectors,  x  and  x  ,  represent  the  position 

P  ® 

‘and  velocity  components  of  the  pursuer  and  e'vader;  the 


control  veccors,  u  and  v,  represent  the  components  of  the 
pursuer's  and  evader's  acceleration  command.';  np  and  ng 
represent  any  disturbance  vector  such  as  the  earth's 

o 

gravitational  field;  R  is  the  3-dimensional  open 

Euclidean  space;  the  6x6  matrices,  F  (t)  and  F  (t),  and  the 

p  e 

6x3  matrices,  G  (t)  and  G  (t),  are  continuous  in  time;  R  (t) 
p  e  P 

and  R  (t)  are  3x3  positive  definite  matrices,  continuous 
e 

2 

in  time;  a  is  a  weighting  factor. 
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The  differential  endgame  has  an  unknown  duration 
(T2-tQ),  tQ  being  the  fixed  commencement  time  of  the  game, 
and  T2  being  the  evader's  unknown  target  time.  The  par¬ 
ticipants  have  an  unknown  engagement  interval  (T^-t^),  T^ 
being  the  unknown  terminal  engagement  or  intercept  time. 

The  unknown  postengagement  interval  is  (T2~T^). 

For  the  differential  endgame  the  payoff  functional  is 
the  engagement's  final  miss  distance,  squared,  weighted 
against  the  difference  between  the  pursuer's  control  energy, 
spent  during  the  engagement  interval  and  the  evader's 
control  energy,  spent  during  the  duration  of  the  endgame. 

Both  participants  have  linear  nonstationary  dynamics, 
defined  by-  the  differential  constraints  (4.2.2,  4.2.3). 

Over  the  postengagement  interval  the  evader's  differential 
constraint  (4.2.3)  is  converted  into  the  integral  constraint 


iti  <  j.  <  rp 

A1  X  1 2 


(4.2.11) 


where  <|^(T2,t)  is  the  evader's  state  transition  matrix,  and 

x  (T0)  and  x  (T,  )  are  the  evader's  unknown  state  vectors  at 
e  2  el 

T^  and  T-^ . 

The  evader's  target  constraints  are  its  target  position 

(4.2.7)  and  its  kinetic  energy  as  it  strikes  the  target 

(4.2.8) .  The  pursuer's  unknown  initial  state  vector  Xp(tQ) 

is  composed  of  its  initial  position  vector  an<^ 

velocity  vector  XD  2  ^  ^  0  ^  ‘  Tae  s^uare  ‘tne  magnitudes  of 
these  vectors  are  constrained  by  (4 . 2 . 5 ,4 . 2 . 6) .  These 
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magnitudes  represent  the  distance  and  speed  of  the  pursuer 

at  the  initiation  of  the  differential  endgame.  Vector 

Lagrangian  multipliers,  X  arid  X  ,  are  introduced  in  order 

p  e 

to.  adjoin  the  differential  constraints  (4 . 2 . 2 ,4 . 2 . 3)  to  the 
payoff  functional  (4.2.1).  The  vector  n  adjoins  the 
integral  constraint  (4.2.11)  to  the  payoff  functional 
(4.2.1).  The  scalar  multipliers  77,  77^,  and  7^  adjoin  the 
evader‘'s  kinetic  energy  constraint  (4.2.8)  and  the  inner 
product  constraints  of  the  pursuer's  initial  position  and 
velocity  vectors  (4 .2. 5,4  .'2 . 6 )  to  the  payoff  functional 
(4.2.1). 


The  differential  endgame  is  expressed  as 

VJ° =^S^v(a2  7  2  <TX  > -xe  C  >  ]  ■  A  ’  AC  XP  ( )  -xe  C  Tx  >  ] 

T1 

+  /  [1/ 2u' R  (t )u-l/2v' R  (t ) v+X_ ' (F  (t )x  +G  Ct )u+n  -x  ) 
•i  P  e  PPPP  P  P 

X0 


+  A  '  GF  (t)x  +G  (t)v+n  -x  )  ]dt 
e  e  e  e  e  e 


4..  2.1  Derivation  of  the  Relationships  that  Determine  the 
Intercept  Time,  Target  Time  and  the  Pursuer's 
Initial  State 

Applying  variations)  §u  and  5 v,  about  a  particular  pair 
of  controls,  u  and  v,  the  first  order  variation  of  the 
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differential  endgame's  constrained  payoff  functional 
(4.2.12),  is 

5J  =[a2(x-  (T.  )-x  (Tn ) ) 'A'A-A*  (T..  )]Sx(T.,  ) 
c  p  i  el  pi  pi 

+  [a2(xe(T1)-jtp(T1))>A'A-X^(T1)-(,'4tt2)T1)]SXe(T1) 

+  [V2+r?xe'2(T2)  ]  5xe(T2) 


+  I-,7rXpl(t0)+^pl(t0^-!5xpl(t0)  +  I-TJvXpl2(t0)  +  ^p2(t0)-]5xp2(t0) 

+ [l/2u(T,  ) ' R  (T, )u  (T,  )+a2[x(T,  >-x  (T,  )]  *  A’ A[x(T.>-x  (T,  )]6T 
±  p  x  l  p  - 1  e  x  pl  el 

+  C^xe2<T2),xe2(T2)"1/2v(T2),Re(T2)v(T2):i5T2 
T 

+  f  1  [<u'R  (t)+X'G  (T))Su+(-v’R  (t)+A  'G  (t))5v 
J+  p  P  P  ’  e  e  e 

.  0 

+ ( V +  V  Fp  >  >Sxp+  <  V  +xs  ’  fc  ( t )  >sxe  :at 

T 

-  /2-[VRe(t)  +  M'(|)e(T2Jt)Ge(t)]Svdt  (4.2.13) 


The  relationships  that  determine  the  intercept  time 
T^,  target  time  ,  and  the  pursuer's  initial  state 
vector  Xp(tQ)  such  that 

^yV’VV’V  =  UcU  vcVJc  04.2.14) 

are  the  Euler-Lagrange  equations  and  their  boundary  con¬ 
ditions.  The  Euler-Lagrange  equations  and  their  boundary 
conditions  are  determined  by  the  differential  endgame's 
constraints  (4. 2. 2-4. 2. 8)  and  the  necessary  conditions 
that  result  by  requiring  SJ  to  vanish.  Table  3  summarizes 
the  necessary  conditions  required  for  5J  to  vanish. 
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Table  3 


Necessary  Conditions  Required  for  $J  to  Vanish 


Variational  Coefficients  of  Variationals  Equated  to 


Bn 


Sv 


8x_ 


8x. 


Sxp(V 


8Xp(Ti) 

Sxe(Tl> 


!^xe2^T2^ 

8T, 


8  T, 


u'R  (t)  +  X  fG  ( t )  =  0 ;  t  '£  t  i  T,  (4. 

p  p  p  u  1 

-v'R  (t)+A  'G  (t)=0;  tn  i  t  £  Tn  (4. 

e  e  e  U  1 

v'Re(t^»',^(T2,t)Ge(t)  =  0;  Tx  <  ti  ,T2  (4. 


\  '  + 
AP 


0  =  0 ;  tQ  i  t  ^  Tx 


Ae'+V  Fe(t)::0;  t0  =  1  "  Tl. 


xpl(V 

xp2(V 


i/nru  0 


0  1/77^ 


LXp2(t0)J 


=  -^VVVV 

A  '(T.  )-a2[x - (T,  )-x  (T,  ) 3 ’ A*  A=  0 
pi  p  1  e  1 


Ae’ (T1)+a^[xp(T1)-xe(T1)]'A'A 


V4(T2,Ti)=o 

1 ?Xg2  ^  2  ^  +  ^2  =  ^ 


1/ 2u(T,  ) ’ R  CT, )  u CT,  ) 

1  p  1  1 


(4. 

(4.. 


(4. 

(4. 


(4. 

(4. 


+a2[x  (T, )-x  (T, )3' A’  A[x  ,  (T. )-x  (T^ ) 3  =  0  (4. 
p  i  el-  P'l  el 

7?xe2(T2),^e2<T2)_1/2vCT2),Re(T2)v(T2)  =  0  (4* 


Zero 

2.15) 

,2.16) 

2.17) 

,2.18) 

2.19) 

2.20) 
2.21) 

2.22) 

2.23) 

2.24) 

2.25) 
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The  Euler-Lagrange  equations  are 


F  (t  )  0  — G  ( t  )/lj^’ (_t.)  G  ’  ( t )  0 

X 

r 

P  P  p  -  -  p 

•P 

(  . 

0  F  (t )  0  GA(t)R“f(t)G  '(t) 

x„ 

r 

, 

e  e  e  e 

e 

+ 

» 

0  0  — F  '  Cvi)  ‘  0 

X 

P 

P 

<0  0  0  -Fe'(t) 

K 

L  eJ 

,  ( 

L 

for  tQ  =  t  i  T1 
and 

xe=Fe(t*)xe-Ge(t)Re1(t)Ge'  (t)3)e»  (T2>t)M+n€ 
T  <  t  ^  T 


The  boundary  -conditions  are 
xe(t0)=xe0 

xpl<t0,="1/!,rApl(t0) 

Xi,2^t0>?-1/Vp2(t0) 

xpl'(t0)xpl(t0)=:R02 

xp2-' ^t0^xp2^t0^sV0 

xel<T2)=0 

*?xe  2(T2)+M2=  0 

xe2^T2^ 'xe2^T2^=VT  : 

X( T,  )=a2A' A[x  (T,  )-x  (T,  )] 
pi  p  1  e  1 

Xe(Ti)=a2A,ACxe(Ti)-xp(Ti)]-^,(T2  >T1)m=0 

l/2u(T1)'Rp(T1)u(T1) 


+a* [x  -(T,  )-x  (T, ) ] ’ A' A[x  (T, )-x^(T, )]=0 
p  1  e  1  pl  ®  1 

7?Xe2(T'2),xe2(T2)"1/2vCT2),Re(T2>v(T2)::0 


(4.2.26) 


(4.2.27) 

(4.2 . 28 ) 

(4.2.29) 

(4.2.30) 

(4.2.31) 
(4. .2. 32) 

(4.2.33) 

(4.2.34) 

(4.2.35) 

(4.2.36) 

(4.2.37) 


(4.2.38) 

(4.2.39) 

The  solution  of  the  Euler-Lagrange  equations  (4.2.26) 

defined  at  T-^  in  terms  of  the  participants’  unknown  boundary 

states,  x  (T, )  and  x  (T, ) ,  and  their  unknown  corner  condition 
’  p  1  e  1  ’ 

vectors,  Xp(T1),  Xg^T^)  are 
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VV^^VVVV'5  k=P>e  (4.2.40) 

Xp^Tl^=<^Tl  *0*Vt*'-Yh't0'W%ih  >V  (4.2.41) 

xe(Ti)=f)e(Ti,to)xe(to)^e(Ti,toUe(Ti)+ke.(T1,to)  (4.2.42) 

where  ^(T^,tQ)  and  (tQ  j^) ;  k=p,e  are  the*  transition 
matrices  for  the  state  and  costate  vectors  j.  the  control¬ 
lability  matrices  are  defined  as 

,t2 

MkCTi>t0)=  I  ^c(^,tj6]?(t)Rjl(t)6k,(t)^c,(-T1,t)dt} 

"O' 

k=p,e  .  (4.2.43) 

and  the  column  vectors  k^(T^  ,4:^ ) ;  k=p,e  due  to  the  dis¬ 
turbance  vectors  n^  are 
T 

kk(Tl>V=  /<§c<Tl’t)n  kdt;  k=p,e  (4.2.44) 

^0 

The  solution  of  the  Euler-Lagrange  equation  (4.2.27) 

defined  at  in  terms  of  the  evader's  unknown  state 

x  (T,  )  and  costate  vector  \i  is 
el 

xe(T2)=^e(T2»Tl)xe<Tl)"Kle(T2»'lil)/i+ke(T2»Tl)  (4.2.45) 

where  the  controllability  matrix  is  defined  as 
T2 

He(T2’Tl)=  /  $e(T2.»t)Ge(t)R^(t)Ge'  (t)$e'  (T2,t)dt  (4.2.46) 

T 

A1 

and  the  column  vector  kgXTgjT^)  due  to  the  disturbance 

vector,  n  is 
e 

T 

r  2 

WV*  J  $e(T2>t)nedt  (4.2:.  47) 

T1 

The  relationships  that  determine  the  Lagrangian 
mule-pliers,  X^(T^) ,  \e(T^)  and  /x,in  terms  of  the  unknown 
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parameters,  ,  T2  and  were  derived  in  Section  3.4. 

They-  are  expressed  as 

'UVa?:A*  AMpCT^  ,tQ )  a2A’  AM^^  ,tQ ) 

i  < 

P 


P.  r 

r-a24,%AM  (Tx ,tQ )  U-[a2A'A-K(r?)]He(T1;.,t0)J  [.W^ 


"a 2  A' 'A  -a2  A' A  *] 

r$,<vv  °  ■ 

r 

a2  A H)\  a2  A  *  A-  K  ( >?=). 

0 

L 

W 


IV  vv 


+  »■  p. 


(4.2.48) 


LVVVJ I  LKC^4CT1,T2)ke(T2,T1)J 

/x=[Me(T2(,T1)-l/»?Q«Q]-1{(^(T2,'t0)xe(t0)+(|)e(T2,T1)Me(T1,t0;Ae(T1) 
+^e(T2,Ti,)ke(^rt.0)+ke(T2,Tl'.}  (4.2.49) 

I/ijVq'Q/x-V  2=  T  p.n1*  0  -  (4.2.50) 

1  i- 0  i' 


The  parameters,^,  and  Xp(TQ),  are  determined  when 
(4.2.-48-4.2.50)  and  the  following  set  of  boundary  conditions 


are  solved  simultaneously: 

VV^VVVV  (4.2.51) 

l/2u(T, ) 1 R_  (T,  )u(T, ) 

1  p  1  1 

+a2Cx  (Tn )-x  (T, )3’ATA[x  (T,  )-x  (T, )]  =  0  (4.2.52) 

pi  el  pi  el 

r?xe2/( T2  )  rxe2  ( T2 )  -1Y  2  v OT 2  )  '  Re,( T 2 )  v  ( T2  )  =  0  ( 4 . 2 . 5  3 ) 

u(T,  )  =  -R  ‘ rl(T,  )G  '  (T..  )A  (Tr)  (4.2. 54  )> 

1  p  1  p  1  p  1 

v(T^ )=Rj^ ( Ti } Ge *  (Ti ) (Ti )  (4.2.55) 

v(T2)  =  -Re_1  (T2)Ge'(T  2)H  (4.2.56) 

Ap(t0)'G(,,r,^v)A’AGO)r,,v)XpCt0)  =  R02  ('4 .  ? .  57) 

X  p  C  t  G  (i)r ,  ,v )  Q '  QG  (  ,  7)  y  )Xp  ( 1 0 ) = VQ  2  ( 4 . 2 5  8  ) 

x  (T.  )  =  F‘  (T,  )x  (T,  )+G  (T,  )u(T,  )+n  (T,  )  (4.2.59) 

pi  pi  pi  ,p  - 1  ■  l  pl 
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Xe(Ti)=Fe(Ti)xe(Ti)+Ge(Ti)v(Ti)+ne(Ti)  . 

•^e(T2)  =  VT2)Xe(T2)+Ge(T2)v(T2)+ne(T2> 

yV=V(Ti>VV(V; 

Xe^Tl^=^Tl*t0^xe^t0^+Me^Tl*;t0^e^Tl^+ke^T:L*t0^ 

^e(T2)=^e(T2’Tl)xe(?l)“Me(T2.»Tl)/<+ke(,T2‘Tl)' 


(4 . 2u  60  )* 

(4.2.61) 

(4.2.62) 

(4.2.63) 

(4.2.64) 

(4.2.65) 


The  boundary  conditions  (4.2.51-4.2.56)  are  the  neces¬ 
sary  conditions  in  Table  3.  The  boundary  conditions 
.(4.2.57,  4.2.58)  are  the  inner  product  constraints  of  the 
pursuer's  initial  position  and  velocity  vectors.  The 
boundary  conditions  (4.2.59-4.2.61)  are  the  participants' 
differential  constraints  defined  at  times,  T^  and  T2<  The 
boundary  conditions  (4.2.62-4.2.66)  are  the  .solutions  of 
the  Euler-Lagrange  equations  in  terms  of  the  unknown  boundary 
vectors  of  the  state  and  costate  vectors. 

4.2.2  Example  of  the  Differential  Endgame  with 
Unknown  Intercept  and  Target  Times 
Presented  here  is  a  differential  endgame  whose 
intercept  time,  T^,  and  target  time,  T2 ,  are  unknown. 

The  relationships  that  determine  the  boundary  conditions 
for  the  Euler-Lagrange  equations  and  the  time  parameters, 

T1  and  T? ,  are  (4.2.48  -  4.2.50),  (4.2.52-4.2.56),  (4.2.59  - 
4.2.61)  and  (4.2.63-4.2.65).  The  dynamics  of  both  partic¬ 
ipants  have  the  form  " 

xkl 
xk2- 


'0 

U* 

“1? 

_ i 

+ 

*0  * 

0 

0€ 

1 

04 

JXj 

u 

uk  + 


»  k=p,e 


(4.2.66) 
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50 , 000 . ft 

150,000 .ft 

1,000. 

5^,  000 . 

70,000. 

90  j'000. 

7 ,000 .ft/sec 

’xe0- 

- 10,000 .ft/sec 

-  100. 

100. 

50. 

. 

-  200- 

The  other  parameters  of  the  differential  endgame  are: 


a2  =  1 

(4.2.68) 

y«  = 

90  [U] 

(4.2.69)- 

Re(t)  -- 

6  0  [U] 

04; 2. 70) 

7000  £ 

llV^  llft/sec  =  10,000. 

(4.2.71) 

Tha  procedure  for  solving  the  differential  endgame 
problem  when  its  intercept  time.  and,  target  time  T2  are 
unknown  is  shown  in  Appendix  8.1.5.  For  this  differential 
endgame  the  effect  of  the  evader’s  target  speed  upon  the 
intercept  time,  target  time,  value,  and  the  terminal 
engagement  miss  distance  are  analyzed.  Figure  3  shows  the 
variation  of  target  and  intercept  times  versus  the  varia¬ 
tion  of  evader’s  target  speed. 

Figure  4  shows  how  the  participants'  control  energies, 
spent  over  the  duration  of  their  flight  times,  and  the  dif¬ 
ferential  endgame's  value  vary  with  the  evader's  target 
speed.  These  curves  are  normalized  with  respect  to  the 
results  that  occur  when  the  target  speed  is  -10, 000  ft/sec. 

For  the  target  speed  of -10,000  ft/sec  the  pursuer‘s  and 

7  7 

evader’s  control  energies  are  1.39  x  10  and  8.32  x  10 

7 

units,  and  the  value  is  -5.42  x  10  units. 


XU  4  U* 


jr"; 

ri 

rp_ 

s* 

?! 

j! y 

3 

r. 

4 

1 

£  =j|  ^i=M=i=]=|=  Ej^pr.  EffiE  -SEtEjsiE  ErEi-SEI- 

^jypjpur'suer 1  s  control  energy: ^igjJIfjiEp fjfj^jijxjll 


■o 

0) 

N 

3  i.o- 

E 


-j-. -u-j-  -  ----- --i~ - 

-evader’s  control  energy rSsi^b-p}-- -~-^|~- 

SSE :  E  E  dE  ? 


^ji|j|value~of  diTferential  endgante|j|i^| 


gpa=|g=fe^  g=£j=i=g  SlEgi  gigiHi 


7000. 


8000.  9000. 

evader's  target  speed 


10000 


Figure  4.  Participants'  Control  Energies  and 
the  Differential  Endgame's  Value 
Versus  Evader's  Target  Speed 


!  O 
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Figure-  ‘5  illustrates  how  the  terminal  miss  distance 
varies  with  the  evader's  terminal  speed.  Here  the  varia¬ 
tion  of  target  speed  has  slight  effect  upon  the  intercept 
time  and  the  value  of  the  differential  game. 

Figures  4  and  5  point  out  that  when  the  evader  is 
required  to  spend  its  control  energy  in  reducing  its 
kinetic  energy,  part  of  this  energy  is  used  in  avoiding 
interception.  This  conclusion  is  supported  by  the  fact 
thati  both  the  pursuer's  control  energy  and  the  terminal 
engagement  miss  distance' increase  as  the  target's  terminal 
speed  decreases.  The  fact  tHai  increase  of  the  pursuer's 
control  energy  partially  eliminates  the  effect  of  the 
increase  of  the  evader's  control  energy  and  the  terminal 
miss  distance,  explains  the  slight  variation  of  the  value 
as  the  evader's  target  speed  is  reduce. 

4 . 3  PARAMETER  OPTIMIZATION  FOR  THE  DIFFERENTIAL  GAME 


For  the  participants'  optimal  strategies,  u*  and  v*, 


and  the  differential  game's  payoff  functional 

J=a^/2[x  (T)-x  (T) ] '  A' A[x  (T)v-x  (T)  ] 
p  e  p  e 

T 

+1/2  f  [u'R  (t)u-v'R  (t)v]dt 
J*.  P  e 


(4.3.1) 


subject  to  the  constraints 


x=F(t  )x_+G  (t )u+n 
P  P  P  P  P 

x  =F  (tJx^+G^CtJv+n^ 
e  e  e  e  e 


W 


eO 


yto,,v(to)?Ro' 

Xp2(V,Xp2(t0)  =  V 


(4.3.2) 

(4.3.3) 

(4.3.4) 

(4.3.5) 

(4.3.6) 
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u,  v£ir 


(4.3.7) 


determine  the  pursuer’s  initial  state  vector.  x^(tg)  and 
the  intercept  time  T,  if  it  exists,  such  that 
W(Xp(tg)  ,xe(tg)  ,tg),  the  value  of  the  differential  game  ,is 
determined  by 

W(xp(t0)’xe(t0)>t0)=u£U  v€VJ  (4.3.8) 

subject  to  the  constraints  defined  by  (4  <  3  ./2-4 . 3 . 7.) . 

The  state  vectors,  x_  and  x  , represent  the--  position 

p  e 

and  velocity  components  of  the  pursuer  and  evader;  the 
control  vectors,  u  and  v,  represent  the  components  of  the 
participants'  acceleration  commands;  n  and  n  represent 

p  e 

any  disturbance  vector  such  as  the  earth's  gravitational 
3 

field;  R  is  the  3-dimensional  open  Euclidean  space;  the 

6x6  matrices,  F  (t)  and  F^(t),  and  the  6x3  matrices, 
p  e 

G  <t)  and  G  (t) ,  are  continuous  in  time;  R  (t)  and  R  (t) 
p  e  .  P  e 

are  3x3  positive  definite  matrices,  continuous/  in  time; 

2 

a  is,  a  weighting  factor. 

The  differential  game  has  an  unknown  duration.  (T-tg), 
tg  being  the  fixed  commencement  time  'of  the  game,;  and  T 
being  the  unknown,  terminal  engagement  time. 

The  differential  game's  payoff  functional  (4.3.1)  is 
the  engagement's  final  miss  distance,  squared,  weighted 
against  the  difference  between  the  participants'  control 
energies.  Both  participants  have  linear  nonstationary 
dynamics,  defined  by  the,  differential  constraints  (4.3.2, 
4.3.3).  The*  pursuer's  initial  state  vector  is  composed, 
of  its  unknown  position  and  velocity  vectors,  Xp^Ctg)  and 
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Xp2^t0^'  sciyare  °f  ‘t^e  magnitudes  of  these  vectors 

are  constrained  by  (4. 3. 5,4. 3.6) .  These  magnitudes 

represent  the  distance  and  speed  of  the  pursuer  at  the 

initiation  of  the  differential  game. 

Vector  Lagrangian  multipliers,,  A  and  A  ,  are 

P  e 

introduced  in  order  to  adjoin'  the  differential  constraints 
(4. 3. 2  ,4. 3. 3)  to  the  payoff  functional  (4.3.1).  The, 
scalar  multipliers,  np  and  i)v,  adjoin  the  pursuer’s 
quadratic  magnitude  constraints  of  its  initial  position 
and  velocity  vectors  (4. 3. 5, 4. 3. 6)  to  the  payoff  functional 

i 

(4.3.1).  The  differential  game  is  expressed  as 
S§S  3K  {a2/2[xp(T)-xe(T)]A’A[xp(t)-xeCT)] 

+  >7r/2(xpl(t0)  *xpl(t0)->R0  )+7?v/2(xp2(t0)  'xp2(tg)-V0  ) 

rT 

+  J  Cl/2u'Rp(t)u-v,Re(t)v+Ap’ CFp(t)xp+Gp(t)u+np4p) 
t0 

+  A  ' (F  (t)x  +G  (t)v+n  -x  )]dtl  (4.3.9) 

e  e  e  e  e  e  J 

4.3.1  Derivation  of  the  Relationships  that  Determine 

the  Intercept  Time  and  the  Pursuer’s  Initial  State 
Applying  variations,  8  u  and  5  v, about  a  particular  pair 
of  controls, u  and  v,the  first  order  variation  of  the  dif¬ 
ferential  game's  constrained  payoff  functional  (4.3.9)  is 
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SJ  =[a2(x .  (T)-x  (T) ) '  A' A-A  '(T)  ]§x  (T) 
c  p  e  P  P 

+  [a2(x  (T)-x  (T^'A'A-AJ  (T)]Sx  (T) 
e  p  e  e 

+  *-7?rxpl^t0^  +  ^pl^t0^^xp/t0^+ -T?vXp2^t0^+^p2^t0^  ^xp2^0^ 

+1/2 CuCT) 1 R  (T)u(T)-v(T)'R. (T)v(T)  + 
p  e 

2  a2(x  (T)-x  (T))  ' A' A(x  (T)-x  (T))]ST 
p  e  p  e 

T 

+  r  [(u’R  (t)  +  A  'G(t))Su+(-v’R  (tHA  'G  (t))$v 
J  P  P  P  e  e  e 


+  ( A  '  +  A  '  F  (t)  )8x+(k  '  +k  '  F  Ct )  )SxJdt 
ppp  pe.ee  e 


(4.3.10) 


The  relationships  that  determine  the  terminal  engage¬ 
ment  time,  T,  and  the  pursuer's  initial  state  vector. 


xp ( t  o ) ,  such  that 

W(x  (t  )  x  (t  )  t  )=^n.MaxJc 
vnxn',Trr  jXe.'>Tn;  »Trr  u<cv  c 


p  O  ’  e  u  *  0  uCU  v€V 

are  the  Euler-Lagrange  equations  and  their  boundary  con- 


(4. 3; 11) 


ditions. 


The  Euler-Lagrange  equations  and  their  boundary 
conditions  are  determined  by  the  differential ’game* s 
constraints  (4 . 3. 2-4  ;-3. 6)  arid  the  necessary  conditions 
that  result  by  requiring  §J  :  to  vanish.  Table  4  summarizes 


the  necessary  conditions  required  for  8<JC  to  vanish. 


The  Euler-Lagrange  equations  are 


SCI  -|f  (t)  0  -6  (t )R^(t )G  *(t) 

#P  P  PPP 

x,  0  F  (t )  0  ( 

e  e 


'xp  np 


G_<t)R'1(t)G ’(t)  x„  n 
e  e  e  e  e 

C  ‘  A  +0  (*+•  3.12 
P 


—  F  ’  Ct) 
e 


■  Xj  o 


Table  4 

Differential  Game’s  Necessary 


Conditions  Required  for  §JC  to  Vanish 


Variational  Coefficients  of  Variationals  Equated  to  Zero 


Su 

u ' Rp ( t )+Xp ’ Gp ( t )  =  0 

(4. 3.1,3) 

Sv 

-v* R  (t)  +  X  ' G_(t )  =  0 
e  e  e 

(4.3.14) 

*XP 

L’+X  ’F(t)=0 

P  P  P 

(4.3.15) 

Sxe 

V+VFe(t)  =  0 

(4.3.16) 

5xP(V 

“  VVl  +  p/7?ru  0  TVVLo 

-xP2(to)J  1-  0 

(4.3.17) 

5xp(T) 

a2 [x  (T)-x  (T)3 ’ A’ A-X  (T)-0 
p  e  p 

(4.3.18) 

$x  (T) 
e 

a2Cxe(T)-xp(T)3’A'A-Xe(T)=0 

(4.3.19) 

ST 

1/2 [u(T) ’ Rp(T)u(T)-v(T j ’ Re(T)v(T)3 
+a2[x-.CT)-x  (T) 3 ' A' A[x  (T)-x  (T) 3=0 

(4.3.20) 
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The  boundary  conditions  are: 


(4.3.21) 

(4.3.22) 

(4.3.23) 

(4.3.24) 

(4.3.25) 

(4.3.26) 

(4.3.27) 

(4.3.28) 


xe(t0)=xe0 

xPi(to)+1/Vpi(to)=0 

Xp2^t0^+1//T?v^p2^t0^  =  0 

xpi(to),xPi(to)::Ro 

Xp2^t0^,Xp2^'t0^  =  V0 

A  ( T )  =  a2  A 1 A [x  ( T )  -x  ( T )  ] 
p  p  e 

Ae(T)=-a2A»ATxp(T)-xe(T)3 

1/2  Cu(T) ' R  (T)u(T)-vXT) ' R  (T)v(T)] 
p  e 

+a2[x  (T)-xq(T) ]' A-' A[x  (T.,  )-xc,(T,  )3  =  0 
p  e  p  1  e  I 

The  solution  of  the  Euler-Lagrange  equations,  defined 
at'  T  in  terms  of  the  state  and  costate  vectors'  boundary 
conditions  are: 

VV<I«,">VV«»  k=P’e  (t.3.29) 

xp<TJ^(T>t0)xp(t0)-Mp(T>t0)Xp(T)tkp(T>t0)  (*4.3.30) 

xe<T)=^e(T,t0)xe(to)+Me(T,t0)Xe(T)H-ke(T,to)  (4.3.31) 

where  ^(TjIq)  and  <£>  '  (Tit.) ;  k=p  ,e  are  the  transition 
matrices  for  the  state  and  costate  vectors;  the  control¬ 
lability  matrices  are  defined  as 
T 

Mk(T,t0)=  J'^(T,t)Gk(t)R"k(t)Gk‘(t)^c'(T,t)dt;  k  =  p,e  (4.3.32) 
t0 

and  the  column  vectors  kk(T,tg);  k=p,e  due  to  the  dis¬ 
turbance  vectors  nk  are: 


kk(T,t0)=  /£k(  T,t)nkdt;  k=p,< 


(4.3.33) 
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•Substituting  Xp(tQ)  (4.3.29)  into  the  boundary  con¬ 
ditions  (4.3.22,4.3.23)  the  pursuer’s  initial  state  vector 


is  expressed  in  terms,  Ap(T),  as 
xp<t0,=-SC!r>5v)$p’(T,tn)Xn(T) 


0"'p 


where 


1/n  U  0  • 

GO?  ,t?  )  = 

r  v'  L  0  1/t?vU. 


(4.3.34) 


(4.3.35) 


With  the  use  of  (4.3.34)  x  (T)  is  defined  as 

P 

xp(T)  = 


-%(T>t0)Gmr,nv%'CT>t0)+M  (T>to):iXp(T)«  (T,t0)  (4.3.36) 


irp'  >r0  r  v  *p  ’  u  rp  ’  '  u - p  p  ’’0 

Substituting  for  *e(T)  and  Xp(T),  (4.3.31)  and  (4.3.36), 

into  the  boundary  conditions  (4.3.26,4.3.27),  the  boundary 

condition  in  terms  of  \p(T),  Ae(T),  and  T?y  are  ; 

U+a2A’ACMp(T,t0)+<^)(T,t0)G(7?r,7v)<^(T,t0)]ia2A’AMe(T,t0) 
[j’®2 A 1 A [Mp( T , t Q )  +<^ ( T , 1 0 ) G ( >  t  q  )  ]  U-S?A’AMe<T,t0>J 

L (T)  0  -a2A’A(f>  (T,tn)  0  a2A’A(k  -k  ) 

P  =  ^  ?  0  +  _  P  e  (4.3.37) 

Ae(T)  '  0  a2A,"A<Pe(T,,t0)J[xe(t0)|  [a^A’A(ke-kp) 

The  parameters,  and  XpCtQ),  are  determined'  when 

(4.3.37)  and  the  fpllowing  set  of  boundary  conditions  are 


solved  simultaneously-: 

xp(to)-G(^ri.nv)Xp(tq> 

l/2u(T) ' R  (T)u(T)-l/2v(T),R  (T)v(T) 
p-  e 

+a2 [x  (T?/-x  CT) ] ' A' A[x  (T)-x  (T) ]=0 
•  p  a  p  '  e 

u(T)=-R  “1(T,)G„’  (T) k  (T ) 

P  P  P 

v(T)=R  ”1(T)G  (T)A  (T ) 

v.  C  C  m 

Xp^o>,^»?r^v)A,AG^r>^vUp<tO)=Ro: 

Xp^o>,G,Cr?r^v)Q,QG(V^v)Xp(tO)  =  V05 


(4.3.38) 


(4.3.39) 

(4.3.40) 

(4.3.41) 

(4.3.42) 
<4.3.43) 
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x  (T)=F  (T)x  (T)+G  (T)u(T)+n  (T)  (4.3.44) 

P  P  ‘  P  P  P 

x  (T)  =  F  (T)x  (T-)+G  (T) v(T)+n  (T)  (4.3.45) 

e  e  e  e  e 

yv=$P'<T>vyT)  (4.3.46) 

xe<T>=$e.(T,t0)xs(t0)+Me(T>t0)Xe<T)+ke(T,t0)  (4.3.47 

xp(T)=<^,WitB)Xp(t0)-Mp(T(to)X.(T)tkp(T,t0)  V  (4.3.48) 


The  boundary  conditions  (4.3.38-4.3.41)  are  the  necessary 
conditions  in  Table  4,  The  boundary  conditions  (4.3.42-, 
4.3.43)  are  the  inner  product  constraints  of  the  pursuer's 
initial  position  and  velocity  vectors.  The  boundary 
conditions  (4.3.44,4.3.45)  are  the  participants'  dif¬ 
ferential  constraints  defined,  at  time,  T  .  The  boundary 
conditions  (4.3.46-4.3.48)  are  the  solutions  of  the  Euler- 
Lagrange  equations  in  terms  of  the  unknown  boundary 
vectors  of  the  state  and  costate  vectors. 

4.3.2  'Launch  Logic  Example  for  the  Differential  Game  with 

the'  Pursuer's  Initial  State  and  Intercept  Time  Unknown, 

Examples  of  differential  games  are  presented  where  the 
intercept  time  and  pursuer's  initial  position  and  velocity 
vectors  are  .unknown.  The  initial  position  and  velocity 
vectors  are  constrained  by  the-  square  of  their  magnitudes. 

For  these  differential  games  the  participants' 
dynamics  are  defined  in  the  X-Y  plane  of  the  cartesian 
coordinate  system  as 


xkl 

0  .U 

xk2 

f 

0 

■  0" 

*  ♦ 

• 

+ 

Uk  + 

• 

• 

xk2^ 

0  0 

xk2\ 

U 

0 

32 

(4..  3.49) 
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the  weighting  matrices  are  defined  as 

R  (tv)‘=r  CU]  =  90[U]  (4.3.50) 

P  '  p 

R  (t )=r  [U]=60[UQ  (.4.3.51) 

e  q 

The  other  unknown  parameters  are  the  weighting  coef- 

O- 

fiqient,  a^l;  the  pursuer's  initial  distance, 

Rq-125,^P0  ft;  and  the  pursuer's  initial  speed, 

Vq=10,:("6o  ft/sec.  The  evader's  initial  state  is  varied 
as  a  function  of  launch  delay,  AtQ.  Launch  delay  is  the 
time  the  pursuer  delays  in  achieving  its  initial  state 
with  respect  to  its  earliest  possible  launch  time.  The 
evader's  trajectory  is  illustrated  in  Figure  6. 

The  results  for  the  differential  game  are  determined 
by  solving  for  the  boundary  costate  vectors,  Xp(T)  and 
Ae-(T).  These  boundary  conditions  are  defined  in 
Appendix  8.2  lin  terms  of  the  unknown  intercept  time  for 
the  parameters  specified  by  (4.3.49-4.3.51).  The 
computational  scheme  used  in  determining  the  intercept 
time  is  shown  in  the  Appendix  8.2.1. 

In  this,  example  it  is  desirous  to  choose  the  pursuer's 
Taunch  delay  and  initial  state  such  that  the  terminal  miss 
distance  is  minimum  and  also  that  the  pursuer's  terminal 
distance  from  the  origin  is  greater  than  155,000  ft. 

Figure  7  depicts  the  intercept  time  and  the  pursuer's 
terminal  distance  versus  launch  delay.  Figures  8  and  9 
show  how  the  terminal  miss  distance  and!  the  pursuer's 
estimated  initial  state  vary  with  respect  to  the  pursuer's 
launch  time  delay. 
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Figure  6.  Evader’s  Estimated  Trajectory  of  Its 


Initial  State  as  a  Function  of  the 
Pursuer's  Launch  Delay  Time 


intercept  time  (sec) 


(1000  ft/sec) 
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From  Figures  7  through  9  it  is  shown  that  if  the  pursuer 

« 

delays  its  launch  by  three  seconds,  it  obtains  the  fol¬ 
lowing  initial  state : 

y  v  * 

The^  intercept  distance  for  the-  differential  game  will  be 
28  ft. 

4.4  SUMMARY  OF  THE  CHAPTER 

The  principal  contributions  contained  in  this 
chapter  are : 

(1)  Formulation  of  the  ..differential  endgame  where 
the  target  time,  intercept  time,  and  the  pursuer’s 
initial  position  and  velocity  vectors  are  unknown. 

The  inner  products  of  the  pursuer's  initial  posi¬ 
tion  and  velocity  vectors  are  constrained.  The 
relationships  that  determine  the  intercept  time, 
target  time,  and  the  pursuer’s  initial  position 
and  velocity  vectors  are  derived. 

(2)  Formulation  of  a  differential  game  where  the 
intercept  time  and  pursuer’s  initial  position  and 
velocity  vectors  are  unknown.  The  inner  products 
of  the  pursuer's  initial  position  and  velocity 
vectors  are  constrained.  The  relationships  that 
determine  the  intercept  time  and  the  pursuer's 
initial  position  and  velocity  vectors  are  derived. 


106185. ft 
65950. 

8495. ft/sec 
527  6  . 


(4.3.52) 
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(3)  Application  of  the  differential  game  in  the  determi¬ 
nation.  'when  the  pursuer  should  begin  the  engagement 
with  the  evader. 
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5.  DIFFERENTIAL  GAME  WITH  AN  ADDITIONAL  PURSUER 
,5.1  INTRODUCTION 

The  differential  game  proposed  here  is  one  where  an 
additional  pursuer  is  cooperating  with  the  primary  pursuer 
that  is  trying  to  intercept  the  evader.  The  objective  of 
this  cooperating  pursuer  is  to  help  the  primary  pursuer 
intercept  the  evader  or  to  increase  the  evader's  cost^  if 
it  is  able  to  avoid  interception.  For  this  class  of  dif¬ 
ferential  games  the  two  poirt  boundary  value  problem  is 
derived  from  the  necessary  conditions  required  for  the 
differential  game's  payoff  functional  to  have  a  saddle 
point.  F  om  the  solution  of  the  two  point  boundary  value 
problem  the  value  of  the  differential  game  is  determined. 
5.2  FORMULATION.  OF  THE  DIFFERENTIAL  GAME 

WITH  AN  ADDITIONAL  PURSUER 

The  special  class  of  differential  games  formulated 
in  this  chapter  is  as  follows,:: 

If 


llx  ,  (T)-x  ,  (T)ll  <  ilzjl  <  II 2  (T)  II-  (5.2.1) 

.  cpl  el  m 

then  for  the  primary  pursuer's  and  evader's  optimal 
strategies  j  u  *  and  v*,  the  d  iff  erential  game's 
payoff  functional 


J=a2/2[x  (T)-x  (T)]'A'A[x  (T)-x  (T)] 
p  e  p  e 

T 

+1/2  /[u'RpCt)u-v'Re(t)v3dt 
t0 


(5.2.2) 


subject  to  the  constraints 
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x  =F  (t )x  +6  (t ) u+ n 
P  P  P  P  P 

VVt)Wt)v+ne 

xp<V=xpO 

xe!tO>=xeO  ' 
u,veR^ 

o 

[x  (T)-x  (T)  ] ’  A' A[x  (T)-x  (T)  ]=  llzjr 
cp  e  cp  e  m 

determine  the  differential  game’s  value, 

W(Xp(tQ) v,xe(tQ)  ,tQ) ,  such  that 

W (v  (t  )  v  (t  )  t  )=(Min  Max  J 
vnxpu:Cr  »xe'r0;  »r0;  uGU  v£V 

subject  to  the  constraints  (5 . 2 . 3-5 . 2 . 8 ) . 


(5.2.3) 

(5.2.4) , 

(5.2.5) 

(5.2.6) 

(5.2.7) 
(  5 .2 . 8 ) 


(5.2.9) 


The  state  vectors,  x^  and  xe,  represent  the  position 
and  velocity  components  of  the  primary  pursuer  and  the 
evader  respectively,  and  XQp  is  the  state  vector  of  the 
cooperating  pursuer;  the  control  vectors,  u  and  v,  represent 
the  components  of  the  primary  pursuer’s  and  evader’s 

acceleration  commands;  n  and  n  represent  any  distrubance 

P  .  3 

vectors,  such  as  the  earth’s  gravitational  field;  R  is 

the  3-dimensional  open  Euclidean  space;  the  6x6  matrices, 

F  (t)  and  F  (t),  and  the  6x3  matrices,  G(t)  and  G  (t),  are 
p  e  p  e 

continuous  in  time;  R_(t)  and  R  (t)  are  3x3  positive  defi- 

p  e 

2 

nite  weighting  matrices,  continuous  in  t;  and  a  is  a 
weighting  factor.  The  differential  game  has  a  finite  dura¬ 
tion  of  (T-tg)  seconds,  T  being  the  fixed  intercept  time. 

The  differential  game’s  payoff  functional  (5.2.2)  is 
the  terminal  miss  distance,  squared,  weighted  against  the 
difference  between  the  primary  pursuer’s  and  evader's 
control  energies,  spent  during  the  engagement  interval 
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(tg,T).  Both  the  primary  pursuer  and  the  evader  have  linear 
nonstationary:  dynamics ,  defined  by  the  differential  con¬ 
straints  (5. 2. 3,5. 2. 4) 

ilZJI  is  the  minimum  intercept  distance  allowed  between 
the.  cooperating  pursuer  and  the  evader,  if  the  evader  is  to 
avoid  interception  by  the  cooperating  pursuer.  If  the 
inequ  ality  condition  defined  by  (5.2.1)  exists,  then 
||xcp^(T)-xe^(T)ll  ,  the  terminal  miss  distance  between  the 
cooperating  pursuer  and  the  evader, is  quadratically  con¬ 
strained  by  (5.2.8). 

||z(T)ll  is  the  terminal  miss  distance  that  results 

from  determining  W*(Xp(tg) ,x^(tg) ,tg)  the  value  of  the 

differential  game  without  the  cooperating  pursuer  by 

/  /.  ,  ..  /.  ,  .  ,  Mm  Max  J  / p  n  i  ^ 


W"(xp(tO),xe(tO),1:0)  =  uGU  vGV 


(5.2.10) 


subject  to  the  constraints  (5 . 2 . 3-5. 2 .7  ).  J  is  the=  payoff 
functional,  defined  by  (5.2.2).  This  differential  game 
has  been  studied  in  reference  (6). 

5.2.1  Terminal  Miss  Distance  Constraint  between  the 
Cooperating  Pursuer  and  the  Evader 
Before  playing  the  differential  game  defined  by 
(5. 2.1-5. 2. 8)  the  evader’s  terminal  miss  distance:  con¬ 
straint  with  the  cooperating  evader  (5.2.8)  is  determined 

in  terms  of  the  evader’s  free  terminal  state  x  tT) . 

e 

The  cooperating  pursuer’s  control  strategy  is  determined 


uinRp/2[VT  >-Xe(T  U'A'Atx  <T>-xeCT>] 


T 

+1/2  f  u'R  (t  )u  dt  j 

i/u  cp  cp  cp  j 

^  rs  . 


(5.2.11) 
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subject  to  the  constraints: 

x  =  Fot^  ( t )  x  +G  ( t)  u  +n  (5.2.12) 

cp  cp  cp  cp  cp  cp 

x  _(tn)=x  r  (5.2.13) 

cp  0  cp  0 

u  <ER3  (5.2.14) 

cp 

where  the  state  vector  x^  represents  the  position  and 

velocity  components  of  the  cooperating  pursuer;  xg(T  ), 

the  evader's  unknown  terminal  state, represents  the 

cooperating  pursuer's  desired  terminal  state;  uCp 

represents  the  components  of  the  cooperating  pursuer's 

acceleration  commands;  n  represents  the  earth's  gravita- 

tional  field;  R  is  the  3-dimensional  Euclidean  space;  the 

6x6  matrix  F  (t)  and  the  6x3  matrix  G  (t)  are  .continuous 
cp  cp 

2 

in  time;  acp  is  a  weighting  factor  and  Rcp(t)  is  a  3x3 
positive  definite  weighting  matrix,  continuous  in  t.  . 

The  performance  criterion  to  be  minimized  is  the 
square  of  the  norm  of  the  ejjror  of  the  cooperating  pursuer’s 
terminal  position  with  respect  to  its  desired  terminal 
position, weighted  against  the  control  energy,  spent  by  the 
cooperating  pursuer.  The  dynamics  of  the  pursuer  are 
defined  by  (5.2.12). 

The  terminal  miss  vector  that  results  from  minimizing 
the  performance  criterion  (5.2.11)  is  derived  in 
Appendix  8.3  and  is  expressed  as 

Cxopl<T)-xel(Tn=:AI:xop(T>-xe<T)]:: 

'^cp^T,^0^A' Ar^^cp^,t0^xcp0+*<cp^’t0^-xe^T^  ^  (5.2.15) 
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where -5)-  (T,tn)  is  the  transition  matrix  for  the  state 
*cp  0 

vector  x  .  M  (T,tn),  the  controllability  matrix, is 
cp  cp  0 

defined  as 

%(T>t0)=  fac p(T>t)Gcptt>RcpCtrlGo,p(t)fept'r>t>dt  <5-2-16> 
o 

and  the  column  vector  k  (T,t~)  due  to  the  disturbance 

cp  0 

vector  n  is 
cp 

VT,V=  f\  p(T>t)nopd1:  C5./2.1’) 

t0 

In  shorthand  form  the  terminal  miss  distance  between  the 
evader  and  cooperating  pursuer  (5.2.15)  is 

CxOpl<T)-xel(T):i=Kl^op(T>t0)xop't0)+kcp<T>t0)-xe(T>]  «-2-18) 
where 

K1=A[U+a^pMcp(T,t0)A,A]'1  (5.2.19) 

5.3  DETERMINATION  OF  THE  TWO  POINT  BOUNDARY  VALUE  PROBLEM 

.-FOR.  THE  DIFFERENTIAL  GAME  WITH  AN  ADDITIONAL  PURSUER 

Vector  Lagrangian  multipliers,  X  and  X  ,  are 

P  ® 

introduced  in  order  to  adjoin  the  differential  constraints 
(5. 2>.  3,5. 2. 4)  to  the  payoff  functional  (5.2.2).  The  scalar 
multiplier,  Y  ,  adjoins  the  quadratic  constraint  of  the 
evader's  terminal  miss  distance  with  the  cooperating 
pursuer  (5.2.8)  to  the  payoff ■ functional  (5.2.2). 
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The  differential  game  is  expressed  as 

Min  Max  J  Min  Maxjr  /m\  (t)1’A’A[x  (T)-x  (T)3 
tiGU  v6V  c  u£U  v6V(L  pu;  xeu'J  A  ALxpU'  xeU'J 

»W2i:<!<op0^op(T*t0)+kcp(T*tp)-xe(T))Kl'x 
Kl<$op(T’tO>xopO+kcp(T’tO)'xe<T))"  '^m'1  ^ 

T 

+  /  [l/2u'  R  (t )u-l/2 v'R  (t )  ?+A_'(F  (t )x  +G  (t)u+n  -x  ) 

J+  p  e  PP  PP  PP 

T0 

+  AJ(F  (t)x  +G  (t)v+n  -x  )  Idt  1  (5.3.1) 

e  e  e  e  e  e  1 

Applying  variations,  Su  and  Sv,  about  a  particular  pair 

of  controls,  u  and  v,  the  first  order  variation  of  the 

differential  game’s  constrained  payoff  functional  is 

5  Jc<  -  Ap '  (  T )  +  a  2  [  xp  (  T )  -,x  e  ( T )  ]  ’  A '  A )  5  xp  ( T ) 

+  (-X' (T)-a2 [x  (T)-x  (T) ] ' A' A 
e  p  e 

■>'(xcpofep<T-tO,+ko,p(T>tO)-xe,(T))K1,Kl  Sxe(I) 

T 

+ /  ^u’Rp(t)+Ap,Gp(t))5u+(-v'Re(t)+Ae,Ge(t))5v 
*0 

+  ( Ap '  +  A? '  Fp  ( t )  )SXp+  ( \e ' +  Ae%<t  )5xe  3dt  (5.3.2) 

Necessary  conditions  required  for  the  game’s  saddle  point 
are  the  coefficients  of  the  variationals  equated  to  zero. 

The  two  point  boundary  value  problem  is  the  set  of 
Euler-Lagrange  equations  and  their  boundary  conditions. 

The  Euler-Lagrange  equations  and  their  boundary  conditions 
are  determined  by  the  differential  game’s  constraints 
(5. 2. 3-5. 2.6)  and  (5.2.8)  and  the  necessary  conditions 
that  result  by  requiring  3 J  to  vanish.  Table  5  summarizes 
the  necessary  conditions  for  5J  to  vanish. 
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Table  5 

Necessary  Conditions  for  SJ  to  Vanish 
Variational s  Coefficients  of  Variationals  Equated  to  Zero 


Su 

u'yt)+yGp(t>=o 

(5.3.3) 

8v 

— v '  R  (t  )  +  A  .  '  G  ( t  j  =  0 
e  e  e 

(5.-3. 4) 

Sx 

A_ 1 +A  '  F_(t)=0 

(5.3.5) 

P 

P  P  P 

5xe 

V+VFe(t)=0 

(5.3.6) 

5xp(T) 

a2  Cxp  (T )  -xe  ( T )  3 '  A '  A-  Ap  C.T, ).  =  0 

(5.3.7) 

Sx  (T) 
e 

y xe ( T ) • Kx • Kx -a2Cxp ( T ) -xe ( T ) 3  ’A  PA- Ae ' ( T ) 

'  ->'[xcp(to4'p<T>tO,+kcp'  <T.t0nKl'Kl'0 

(5.3.8) 

O 


The  Euler-Lagrange  equations  and  their  boundary 
conditions  are 


X 

p 

■0*1 

ft 

N-/ 

O 

— G  ( t ) r5 ( t )  G  '  ( t )  0 

P  P  P 

XP 

n 

xe 

0  F  (t) 

e 

0  G  (t)R"5(t)G' (t) 

e  e  e 

Xe 

n 

*p 

# 

0  0 

-F  ' (t)  0 

.  P 

>0 

+ 

0  0 

0  — F' (t ) 

e 

lm  J 

(5. a. 9) 


(5. 3,.  9) 

Xp(t0)=Xpo  (5,3.10) 

xe^0^  =  xe0  (5.3.11) 

Ap(T-)=a2A’ACx  (T)-xe(T)]  (5.3.12) 

yx  (T)  ’  K,  *  K,  -a2  [x  (T)-x  (T)  3  '  A’  At k  '  (TV 
e  1  1  p  e  e 

-^p<V$cV(T’V%,(T’V]VKl=0  (5.3.13) 

Cx  (T)-x  (T) ]' A*A[x  (T)-x  (T) 3=  ||zj|2  (5.3.14) 

cp  e  cp  e  m 


The  solution  of  the  two  point  boundary  value  problem 
(5.3.9-5.3.14)  determines  the  optimal  strategies  of  the 
participants,  the  terminal  miss  distance,  and  the  value  of 
this  differential  game. 

5.4  SOLUTION  OF  THE  TWO  POINT  BOUNDARY  VALUE  PROBLEM 

The  solution  of  the  Euler-Lagrange  equations  (5.3.9) 

defined  at  T  in  terms  of  the  primary  pursuer’s  and  evader's 

unknown  state  vectors,,  x  (T)  and  x  (T),  and  their  unknown 

p  e 

costate  vectors,  A  (T)  and  X  (T),are: 

p  e 

VT)4k'(VTUk(t0,!  k=p (5.4.1) 
Xp(T)4p(T)t0)xp(T0>'-Mp(Tvt0)Ap(T)+kp(T,t0) 
xe(T)=^(T>t0)xe(.t0NMe(T,t0We(T)+ke(T1t0) 


(5.4.2) 

(5.4.3) 
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where  <P^(T,tg)  and  ^)k' (tQ  ,T) ;  k=p,e  are  the  transition 
matrices  for  the. 'state  and  costate  vectors;  the  control¬ 
lability  matrices  are  defined  as 
T 

Mk(T,t0)=  /$k(T,t)Gk(t.)Rk(tr1Gjc(t)f>k'Cr>t)dt;  k=p,e  (5.4.4) 
t0 

and  the  column  vectors  k^'T^tg) ;  k=p,e  due  to,  the  distur¬ 


bance  vectors  nk  are 

-T 

kk(T,tQ)=  J  (|)k(T>t)nkdt;  k=p,e 

t  r, 


(5.4.5,)- 


The  two  point  boundary  value  problem  is  solved  when 

the  multiplier  vectors,  X-.CT)  and  X  (T),  and  the  scalar 

P  ^ 

multiplier,  y,  are  determined.  Substituting  (5.4. 2,5.4. 3) 
into  the  boundary  conditions  (5;3.7,5.3.8)  these  boundary 
conditions  are  expressed  in  terms  of  the  multiplier  vectors, 


X  (T)  and  X  (T),. and  the  scalar  multiplier, ,y . 
P  e 


'  U+a2A«AMp(T,tQ)  a2A'AMe(T,^0 )  YVT)‘ 

-a2A'AM(T,tn)  U-[a2A*'A+yK,  %  ]M0(T,  ,tn)  X  (T) 
p  u  l  i  e  -  1 '  u  e  -1 

fa2A'A$p(T,tQ)  -a2A’A(^(T,t0)  1  rxp(tor 

L-a2A«4>  (T,t0)  Ca2A'A+yK1,K1]^(T,t0)  J^ltg). 


2  2 
a  A'A  -a  A’ 


2  2 
,-a-A'A  aA 


a'a  irkP(T,to)i  J  0  °  irvv 

.'A^K^kJU  (T,t0)j  K^JI-k op<T,t0) 


(5.4.6) 


The  terminal  miss  distance-  constraint  between  the  evader 
and  the  cooperating  pursuer  is  expressed  in  terms  of  Xg(T) 


[xcpl(T)-xel(T);i,i:xcpl(T)“xel(T):i  = 
CK'-X^(T)M^(T,t0)3K1'K1CK2-Me(T,tI0)Xe(T)]=  WzJ 


(5.4.7) 
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where 


K2=$op(T.t0)xoD0+kODtT>t0)-4<T>t0>xe0‘ke(T’tn>  <5-'*'8) 


2  *cp  *  0J  cpO  cpu  >1;0*  *-evl  ’ T(r  xeO~Ke^ 1 ,1:(r 
The  boundary  costate  vectors,  X  (.T)  and  Xe(T),,  and  the 

scalar  multiplier,  y  ,  are  determined  by  solving  the  simul¬ 
taneous  equations  (5. 4.6, 5. 4. 7).  With  A,(T)  and  A  (T) 

p  « 

known,  the  solution  of  the  two  point  boundary  value  problem 
is  determined .  Knowing  the  solution  of  the  two  point 
boundary  value  problem, it  is  determined  whether  or  not  the 
primary  pursuer  intercepts  the  evader. 

5."5n  EXAMPLE  OF  A  DIFFERENTIAL  GAME  WITH 
A  COOPERATING  PURSUER 

For  this  differential  game  the  dynamics  of  all  partic¬ 
ipants  are  defined  as 


Hr  T1]  ♦  piv  n 

XV9J  Lo  oJLx,  J  -LuJ  k  J  n 


'k=p  ,  cp  ,e 


the  weighting  matrices  are 
^Lt)=rjcCU]  =  90CU] ;  k=p,cp 
Re^)::^Cu3=60Cu] 

the  weighting  coefficients  are 

2  2 
a_n  =a=l 

cp 

The  initial  state  for  all  participants  is 


(5.5.1) 


(5.5.2) 

(5.5.3) 


(5.5.4) 


103600. ft 


75200. 


99800. ft 


75200. 


8079. ft/sec  ’  cpO”  8079. ft/sec  ’XeC"  -10000 . ft/sec 


5894. 


5894. 


150000. ft 


90000. ft 


i 

i  -loo. 

L“  (5.5.5) 


terminal  miss  distance 
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The  results  for  this  differential  game  depend  on  the 

determination  of  the  Lagrangian  multipliers,  \  (T) ,  Ae(T) 

and  y .  These  Lagrangian  multipliers  are  defined  in 

* 

Appendix  8.4  in  terms  of  the  parameters  specified  by 
(5.5. 1-5 .  5 . 4>) . 

For  this  particular  differential  game  ||Z(T)II  =  4744  ft 

while  Hx  ^(T)-xe^(T)ll  =  1357  ft.  The  problem  is  to 

determine  the  minimum  value  of  II Z  II  such  that 

m 

1357ft  ±  HZ  II  4  4744  ft  (5.5.6) 

m 

and 


llx  ,  (T)*x-  (T)ll  ^  IIZJI 

pi  el  m 


(5.5.7) 


Figure  10  illustrates  how  IIXp^(T)-xe^(T)ll  varies 

with  IIZmll  .  From  Figure  10  it  is  seen  that  the  value  of 

IIZ  II  =3125  ft  satisfies  (5. 5. 6,5. 5.7) 
m 

5 . 6  SUMMARY 


The -principal  contribution  contained  in  this  chapter 
is  the  formulation  of  a  class  of  differential  games  where 
an  additional  pursuer  is  cooperating  with  the  primary 
pursuer-  that  is  trying  to  intercept  the  evader. 


t 
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6.  CONCLUSION 

It  is  evident  that  differential  game  theory  is  an 
effective  tool  for  analyzing  pursuit-evasion  problems.  Here 
it  is  attempted  to  apply  differential  game  theory  to  two 
types  of  pursuit-evasion  problems,  the  endgame  problem  and 
the  differential  game  with  a  cooperating  pursuer.  Also,  it 
is  -shown  how  differential  game  theory  is  used  to  determine 
the  differential  game  .parameters,  such  as  intercept  time, 
pursuer’s  initial  state.;  and,  in  the  case  of  the  differential 
endgame,  the  target  rime. 

Further  areas  of  research  resulting  from  this 
dissertation  could  be: 

(1)  A  differential  endgame  with  an  additional  pursuer, 
cooperating  with  the  primary-  pursuer  that  is  trying 
to  intercept  the  evader. 

(2)  Development  of  a  differential  game  theory  that  can  be 
applied  to  a  differential  game  that  has.  more  than 
three  participants. 
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APPENDIX  8.1 

Determination  of  the  Corner  Condition  Costate  Vectors 
and  the  Postengagement  Costate  Vector  in  Terms 
of  the  Specific  Differential  Endgame  Parameters 


Here  the  corner  condition  vectors,  \p(T^)  and.Ae(T^), 
and  the  post  engagement  costate  vector  fi  ,  as  defined  by 
(3.4.13)  and  (3.4.16)  ,  are  expressed  in  terms  of  the  specified 


parameters  of  the  differential  endgame.  These  parameters 
include  the  initial  state  of  the  game,  target  constraints, 
participants'  dynamics  and  the  diagonal  weighting  matrices 
as  specified  in  Section  3.6. 

8.1.1  Determination  of  B (77 ) 

With  .reference  to  the  participants'  specified  dynamics 

*  s 

(3.6.1)  and  the  diagonal  weighting  matrices  (3.6.3),  the  state 
transition  matrices  and  the  controllability  matrices  are 
defined  in  term's  of  partitioned  diagonal  matrices  as 

4^Tl»t0)  =  [p  u  ]  *  *  8  P»  •  (8.1.1) 


$e<T2,  Tx>  = 

Mk^Tl*  V  = 

= 


r»i 

' [(kr)3/3rk-3 
_  [(kr)2/2rk.) 


r  (kr)2/2rkj  J 

[kr/rk.)]  / 


"Cr3/3rej3  C  r2:/2re^  j" 

[  r2/2rgj  ]  Cr  / rej  3 

—  m 


(8.1.2) 


* 

k=p,e  (8.1.3) 


(8.1.4) 


*The  elements  of  the  partitioned  matrices  represent  the 
general  diagonal  term. 
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Where  the  engagement  interval  is  defined  as 

(Tx  -  tQ)  =  kr  (8.1.5) 

and  the  post  engagement  interval  is  defined  as 

(T2  -  T1)  =  r  (8,1.6) 

The  factor  k  must  be  chosen  such  that 

r+  kr  -=  (T2  -  tQ)  (8.1.7) 

In’  terms  of  the  evader's  state  transition  matrix  and 


controllability  matrix  over  the  post  engagement  interval 


the  matrix  K(>j)  defined  by  (3.4.12)  is  expressed  in  terms 
of  partitioned  diagonal  matrices  as 

f~12r  *(r-r  ./J?)  ~  H 


K(r?)  = 


(8.1.8) 


E6re.:(r-2rei/,) 


[6re.(r-2re./,)]  j(r-3r  /,) 

r2(r -4reJ>  !i) )  >Cr-4r  ) 


The  matrix  B(r?)  defined  by  (3.4.11)  is  partitioned  into 
four  (6x6)  matrices  which,  in  turn,  are  partitioned  into 
four  (3x3)  diagonal  matrices.  Therefore *  the  four  (6x6) 


partition  matrices  are 


Bn=  U+a  -A'A 


[1+a2  (kr) 3/$r_  .  3  [a2(kr)2/2r  .31 

P3  PD  (8.L9) 


B12=a?A«A  Me(T1,t(J)  = 


[a2(kr)3/3r  .]  [a2(kr)2/2r‘  .  ] 


B21=  -a  A’A  VW  j 


[-a2(kr)3/3r  .]  [-a2 (kr)2/2r .) 

P3  pi 


(  8.1.10) 


(8.1.11) 


and 
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B22(>})  =  U  -Ca^A’A  -  K(i))]M  (t,tQ) 


(8.1.12) 


(B22(t?))11  <‘B22<' ’?))12i 
(B22(i?))21  (B22(J7))22 


(8.1.13) 


where  the  following  (3x3)  diagonal  matrices  are  defined  as 


(B22  (17)  )n 


a2k3r 3  J  k2(4k+3)r-2k2(2k+3)r  ./n 
x  -  — - -  +  •  ei  • 


(B22^^i2 


3reD 

2,,.  *2 


r“  4rej'* 


-a  (kr )  +  6k(k+l)r-6kre(k+2)/r) 

2rej-  r  (r  -4re  j  /»? ) 


(B22(,))  =  2k2 (k+l)r2  -  2k2(2k+3)reir/, 

(  t  -  4rej/J?.5 


(B22(i?))22  =  1  + 


k(3k+4)r  -  6k(k+2)re^/j? 


~r~  4r  •  It) 
ej 


11 


(8a. 14) 


(8.1.15) 


(8. 1.1-6) 


(8;  1.170 


B(i7) 


.-1 


Now  in  terms  of  the  (6x6)  partitioned  matrices 
(B11-B10B00(rj)B/,nr1!  -CB,,-r  “  *  ‘  ^ 


-CB-,0(i?)-B21B^B^2)B2]LB11|  (B22C»?)-B2iBiiBi2 ^ 


311“B12B22 ' 71  )B215  (  “(Bll"B12B22(,?)B2iBl2B22 

*22 

B(i?)  ^  is  partitioned  into  (3x3)  diagonal  matrices  as 
follows.  The  general  diagonal  terms  of  these  partitioned 
matrices  are  defined  as 


(8.1.18) 


B  llw  =  aik(3)  +  ftkC;i>/i 7 
lk  — - gfrj)  ;  i  =  1,  4;  k  =  1,  4 

where  A(j)  and  a_^ (\j )  +  ^^(j)/^  are  expressed  as 

A2(j) 


(8.1.19) 


A(j)=A1(j)  + 


1 3r  .r  .  (k+l)4r  +a2k3(k+l)  Cr  .  (k+l)3-r  .  ]r41 
(  PD  ©D  e_3  PD 


+  j-12rp.rej2(k+l)3+re.a2k3[(4+3k)rpj-4re.(k+l)3]r3j/r?  (8.1.20) 


92 


tt  - 


o 


o 


o 


)/i7  =  3rpjrej  t<k+l)4r -a2k3  (k+1)  r4/3r>e;.  ] 

+  3r  .r  .[-4,<k+l)3rp.+a2k3(4  +  3k)r3/3]/»? 

PD  63  ej 

a19(j)  +  A2(3)/r?  =  -l-5reja2k2(k+1)4f3 


+  6r  .2a2k2(k+l)3r2/>7 
eD 


oXj  >+^i  3(3  >/j7  =  -r0.a2k3(k+l)r 


13; 


13 


PD 


+r  .r  .a2k3(3k+4)r3/'Jj 
PD  eD 


63.4(3)  +/514('D’-)"/t?  =  1.5rpja2k2Ck2-l)r3 


+  3r  .r  .a2k2(2-k2)r2/rj 
PD  ej 


«2k(D)  +  ^)/l}  = 


S,<3)  + 


0  j  k.  =  1 ,  3 ,  4 
A;  k  =  2 
/331<D> 


31 

=r  .a2k3(3k2+4k+l)r4-a2k3(6k2+12k+4)re.2r3/i? 
ej  J 


^o(D) 


,^,'32 

"32(:i)  rj 


=  1.5re.a2k2(31<2+4k+l)r3  - 

e3 

3a2k2(6k2+12k+4)  2f2 

TJj  ej 


o33(j)  +  /333(j)/1  =  t3r.pjrej(3kWl)r+a2k3rej(3k 

-[3r  .r  .2(6k2+12k+4)+a2k3r-.2(-6k2+I.2k+4)r3]/’) 

PD  eD  3 

°34 i-18rpjrejk(ka)+I;l-5a2k2rpD-6r'®j 

+  !l8r,.2r  .k(k+2)/r+C6re.2a2kl|(k+2)-6re.r  ^a2k2] 
(  -J  PD  J  j 

«4l(rj  )+i34i(D)/,?=-2a2k5(k+1)rejr5+2a2k5(2k+3)rej2 


(8.1.21) 

(8.1.22) 

(8.1.23) 

.  (8.1.24) 

(8.1.25) 

(8.1.26) 

(8.1.27) 

•+4k+l)r4] 

(8.1.28) 

a2k2(k+l)Ir3} 
f2\/Tl  (8.1.29) 
r4/r?  (8.1.30) 


* 
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au 9 <  j  )  +  /?; 4 3.) A}  =  - 3r  . a2 k4  ( k+ 1 ) t 4  +  3a2 k4  ( 2k+  3 ) r  . 2 r 3 h  <6.1. ,31) 


%3<j)  +  Al3^)/7J  =  (:-6rp.re.k2(.k+1)r2-2re.a2k5(k+1)r53 

+  [6r  .r  .2k2(2k+3)r  +  2r  .2a2k5(2k+3)  r4]/?}1 
P3  =j  eJ 


(8,1.32) 


Ail*^ 


V<3>  +~Tj~  =  (3fpjre.(i+3k2,4k3)r  + 

a2k3tre.-ri);j+k2(4k+3)rej]'4} 

- {Sr  .r  .2(2+3k2+2k3) 

1  p]  e] 

+2r  . a2k3[2r  . . -2r  .+r  .k2(2k+3)]r3}/7j 
ej  e]  p3  ej  ' 


(8.1.33) 


8.1.2  Determination  of  the  Corner  Condition  Costate  Vectors 
The  solution  for  the  corner  condition  costate  vectors 


derived  in  Section  3.4  is: 


X(T1)  =  BO?)-1jc(t))  x ( 1 0 )  +  %(."*) )  | 


(8.1.34) 


With  the  aid  of  (3.4.11)  and  (8. 1.1-8. 1.4)  the  column 
vector,  C(y))  x(tQ)  +  ^(i?)»  is  partitioned  into  3x1  column 
vectors : 


cki<^)  4  dki(3>^ 

C(H)  x(tQ)  +  1(H)  = 


(8.1.35) 


Ckl(^HdklC^^ 

r4-4r  .  r3/-)9 

L.  eD  — 

whose  general  terms  c^(j  ^+dkl^ )  >  ^  =  1,  4  are  expressed  as 
°)<1<j)+dkl<j)/’)  =  [r‘,-'tre.r3/H](a2Cxplj(to)-xelj(to):l* 


a  k,txp2j(tO>-y:c2:Cto'):|) 


(8.1.36) 


c  (j)  +  d,n(j  )/-n  ~  o 


(8.1.37) 


e*V<5>  + 


( {-a  r  Cxplj  <tQ)+krxp2;.  (t  0).]  +  Ca  r  -12r>  e,.  r  ]xel^  (tQ ) 

+  Ca2kf5-6re/(2k+l)r2]xe2..(t£j)-6(j-l)(j-2)re.k(k+l)r3g| 

+  i‘tre.ja2r3txplj<t0)+krxp2.(,t0).:|+C12rej2-4re.a2r3]x?1,:(to) 

+  [12r  . 2(k+l)r-4r  .a2kr4]x  0 .  Otn) 
e3  e]  e/3  u 


+  6  ( j  -1 );( j  -  2 )  r  .  2  ( k+ 1 ) 2  r  2  g }  h\ 


(8.1.38) 


?41(j)+d41 (j)/7J  =  |-6rejr2xeij(t0)-2rej(3k+2)r3xe2j(t0) 
-(j-l)(3-2)rej(k+l).(3k+l)r4g}  +  |l2rej2r  x?lj(tQ) 

+12rej2(k+l)r2xe2j(t0)  +  6rej2(k+l)27  3g(3_i)Cj_25/T?}  (8.1.39) 

Now  carrying  out  the  matrix  operation  defined  by 
(8.1.34)  the  corner  condition  costate  vectors  partitioned 
into  (3x1)  column  vectors  are  expressed  in  terms  of  Vj  ; 

W=jkJ 

+  (i'/3ik(j)dki(j))  (l/ij)2!/ 


+  CI>ltA2(j)-4re^r3&1(j)]l/i)-[*(re.  r3A2(j)Kl/^)2|;  i=:l»  4(8.140) 
The  j  index  indicates  the  components  of  \. (T, ) . 


where 


V(v 

W 


VV' 

W 

:W 


(,8.1.41) 


8.1.3  Determination  of  the  Evader's  Costate  Vector  During 
the  Postengagemeni  Interval 

With  reference  to  (3.4.16)  the  components  of 

the  (3x1)  partitioned  costate  vectors  and  /*2  are  defined 

in  terms  of  the  components  of  the  corner  condition  costate 

vectors  as 

^(j)  =  {l2rej(.r-r^./t,)(xelj(t0)  +  Ck+l)rxe2j(1:p) 

+  [k2 (2k+3)r  3A  .  .  (Tr)+3kr2(k+2)X  0-.-(Ti  ) 3 /-6r*  . 

elj  1  e2j  1  ej 

+'(3-1  X(  j  -  2 )  ( k+1 ) 2  r  2  g/  2 )  ~  6re .  r  2  ( xg  2  j  ( t  q  ) 

+'Gk2r  2Xe^j  (T^)+2krAe2  j  (T^)  ]/2r£  j  +  vj-l)  (j-2)  (k+1)  rg)} 

/[r-4r  .T3/Vl  •  (8.1.42) 

e] 


M2  ( 3  )  =  {  -  6r ^  .AXei  j  ( 1 0 )  +  ( k+ 1 )  r  x e 2  j  ( 1 0 )  +  C k 2  ( 2 k+  3 )  r  3 A  j  C Tx ) 
+  3kr2(k+2)A^2j(T1)]/6re^  +  (j-l)(j--2)(k+l)2r2g/2) 


+4rA  .  r  ( . ( t  n ) +  Ck lx  .  (T, ) -2 k  r A„  0  .  ( T , )  ]  /  2r 


'  ej  e2  j  0 


elj  1‘ 


e2 j  1  ej 


+  ( j  -1)  (j-2)  (k+1)  rg)}/ [r2-4re.  r/77] 


(  8 . 1  r  4  3  ) 
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8.1.4  Generation  of  the  Target  Kinetic  Energy  Constraint 
as  a  Polynomial  in 'Terms  of  V) 

With  reference  to  (3.4.17)  th~  target  kinetic  energy- 

constraint  is 

(I/17) 2  -  VT2  (8.1.44) 

Since 

R  =  r  CU3  (8.1.45) 

P  P 

and 

R  =  r  [U]  (8.1.46) 

e  e 

The  coefficients  of  -the  (1/7) )  terms  in  the  denominators 
of  the  corner  condition  costate  vectors  A(j)  become 
invariant  with  respect  to  the  j  index 

A ( 3 )  =  A(l);  3  *  1  (8.1.47) 

If  the  components  of  are  substituted  in  , 

(8.1.43)  /*2(j)  has  the  form 

an(j)+a,  (j  )/7)+a2(  j  )/tj2 

^(j  )  =  — - — - 5 - 5 — ;r—  (8.1.48) 

b0+b1/7)+b2/i?/+b3/77J 

Now  substituting  the  components  of  /x2(j)  into  (8.1. 44)  the 
resultant  rational  fractional  p  o  1  y  nomial  in  terms  of  I/17 
is 

.3 

- - i — y1 - TT  \  l/*) 2  <  an  (  3  )+a,,(  j )  ty\  +aA  j )  /tj2)2  =  V  2(8A.49 ) 

(b0+biy7j+b2/7?Z+b3/7)3)2jtl  0  1  2  T 

Now  by  multiplying  (8.1.  49)  by  one  obtains 

a  polynomial  of  the  form 
6 

2  P^jb)1  = 
i=l  1 


0 


(8.1.50) 
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8.1.5  Procedure  for  Solving  the  Euler-Lagrange  Equations 
when  the  Intercept  and  Target  Times  Are  Unknown. 

With  reference  to  ( 3 . 4 . 1 ,3 . 4 . 2)  and  (3.4.5)  the  solu¬ 
tion  of  the  differential  endgame's  Euler-Lagrange  equations 
depends  on  the  determination  of  the  vector  multipliers, 
^p^Tl^’  ^e^Tl^  and  m >  when  the  intercept  and  target  times 
are  known.  The  relationships,  derived  in:  Chapter  3,  that 
determine  X  (T.  ) ,  X  (T, )  and  i>  are.: 

.p  «L  6  • 

r\,  ( «+-  ^  i 

'  fw 


BO?) 

W 

•VV- 

M- 

C  (*?) 


vv 


Lxe(to)J 


VV 


(8.1.51) 

+$(»*)) 


+^e(Tl »t0)xeCt0^+ke^Tl  ,t0>+^('I'l  ,T2^e(T2  ,T1^ 11  (8.1-52) 

.1/J72/z'Q'Q/x=Vt2  (8.1.53) 

When  the  intercept  and  target  times  are  unknown,  the 
additional  boundary  conditions  needed  to  determine  the 


intercept  time  T^ ,  and  the  target  time  T2  are : 
u(T, )=-R  "1(T1 )G  ' (T.. )X^(T, ) 

i  p  1  p  1  p  1 
v(T1)=Re"1(T1)Ge'(T1)Xe(T]L) 

v(T2)=-Re_1(T2)Ge'(T2)^ 

x  ("V)=F  (T,  )x  (T,  )+G(T,  )u(;r,  )+n(T.  ) 
pi  plpl  pi  1  Pi 

xe(T1).=  Fe(T1)xe(T1)+Ge(T1)v(T1)+ne(T1) 
*e(T2)=Fe(T2 )xe(T2 )+Ge<T2 >v(T2 )+ng(T2 ) 
xe(T1)=$e(T1,t0)xe(t0)+Me(T1,t0)Xe(T1)+ke(T1,t0) 


(8.1.54) 

(8.1.55) 

(8.1.56) 

(8.1.57) 

(8.1.58) 

(8.1.59) 


(8.1.60) 
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Xp(Ti)=^(Ti  Jt0)Xp(t0)-Mp(Ti  »'t0)Xp(T1)+kp(T1>t0)  C8.1. 61) 

xe<T2)=$e(T2»Tl)xe(Tl)*-Me(T2»Tl)M+ke(ir2’,ri)  (8.1.62) 

l/2u(T, )  'R  (T,  )u(T,  )  +  a2  [x  (T,  )-x  (T, )  3 1  A' A[x  (T.  )-x  (T, )  ]  =  0  (8.L63) 
1  p  1  1  pi  el  pi  el 

ijxe(T2),Q'Qxe(T2)-l/2v(T2)'Rei(T2)v(T2)  =  0  (8.1.64) 

The  procedure  for  determining  the  multiplier  vectors, 

A^(T^),  Xg(T^)  and  fit  and  the  intercept  and  target  times  is 

as  follows : 

1)  Choose  a  combination  of  discrete  values  for  the  intercept 
and  target  times 

Tl=Tli+nATl;  n=1>  - f  (8.1.65) 

T2=T2i+nAT2’  n  =  (8.1.66) 

where  and  T^  are  the  initial  intercept  and  target 

times;  AT^  and  AT2  are  the  incremental  changes  of  the 
intercept  and  target  times. 

2)  For  any  set  of  and  T2  values,  a  (Tp,  Ae(Tp  and  fi 
are  determined  by  solving  (8.1.51-8.1.53). 

3)  With  the  solution,  of  (8.1.51-8.1. 53)  the  boundary 
conditions  defined  by  (8.1.54-8.1.62)  are  determined. 

4)  Substituting  the  boundary  conditions  determined  by 
(8.1.54-8.1.62)  into  (8.1.63,8.1.64)  it  is  determined 
whether  (8.1.63,8.1.64)  are  satisfied  simultaneously. 

5)  If  (8. 1.63, 8. ,1.64)  are  not  satisfied  simultaneously, 
then  T1  and  are  updated.  This  procedure  is 
repeated  for  all  combinations  of  T^  and  T2  values  until 
(8.1.63-8.1.64)  are  satisfied. 


APPENDIX  8.2 

Determination  of  the  Boundary  Condition  Costate 
Vectors  in  Terms  of  the  Terminal  Engagement 
Time  and  the  Specific  Differential  Game  Parameters 

The  solution  of  the  following  equations,  derived  in 

Section  4.3,  determines  the  boundary  costate  vectors, 

A  (T)  and  \  Cl),  in  terms  of  the  terminal  engagement  time  T. 
p  e 

Xp(T)1  p+a2A'4[Mp(T>.ta)4>p<T.t0)G(')r.nv%'<?»V;iia2A'AMetT’V 

Xe(T)J  L-a2A''A[Mo(T,t0)H$n(T,t0)G(nr^v)t>p'(T1tilH:B-a2A,AMe(T>1; 


y  u  »  «  u  pXi,l'0/  Tp 

•o  -a2A'A4(T,tn)T  0 


0  a  A' A<1>  (T 


,t0)T  0  ]  piA’ 

e>*  -Xe(t0).  a2  A' 


A(k  -k  )] 
p  e 

A(k  -k 
e  p  J  / 


(8.2.1) 


Ap‘(T)$p(T,t0)G'CJJr,r,v)A«AG(vr^v)^,’(T,t0)\p(T)  =  R02(8.2.2) 
ApMT)§p(.T,t0)G,(7,r,^v)Q«QG(>7r,nv)$p'(T,t0)Ap(T)  =  V02(8.2.3) 
When  the  dynamics  for  both  participants  are  specified 


xkll  r°  U1  FX’ 
*k2J  LO  oJU 


>  k=p,e 


(8.2.4) 


and  the  weighting  matrices  are  specified  as 

Rk(t)=rkCu];  k=p ,e  (8.2.5) 

the  transition  matrices  for  the  participants  become  : 

_  fu  (T-tn) U 

<pv(T,tn)  =  ;  k=p ,e  (8.2.6) 

K  U  0  U 

-  • 

and  the  controllability  matrices  for  both  participants 


become  ; 


-  100  - 


1ks  ’  O' 


•-3 

1 

cfr 

O 

w 

CO 

IT 

(T-t0>2 

It 

3rk 

u 

2rk 

(T-t0)2 

TT 

(T-t0) 

_  2rk 

U 

rk 

>  k=p,e 


(8.2.7) 


Substituting  $j,(T,t0)  and  Mk<T,t0)i  k=p,e  into  C8 . 2.1 ,8 . 2 . 2) 
these  relationships  are  reduced  to 

»r2  »  i/R02  Vi(T  ,2  (8'2'8) 

%  -  VT-WVJ  (8-2-9> 

and  the  components  of  the  costate  vectors?  boundary  con¬ 
ditions  become: 

Xeli(T  )  =  a2CxeliCt0)  +  (T  -tO)xe2i(tO)3/Cl+a2(T  _t0)3>< 

(1/ 3r  -  l/3r  )^a2(l+(T  -tQ)V  /R0)/V;  '  i=1»3  .  (8.2.10) 

p  e  . 

aQ(i) 

Xpli(T  )  =  b0(i)+b zjnrnZ  ;  i=1»3  (8.2. n ) 


^liv  1  *  -  uovx/  '  *r  ’  7 

Ap2i(T  5  =  WV  =  °-  i=1>3 

where 

a1  (T 

a0(i)=-a2[xeli(t0)t(T-t0)xe2..(t0)][lt^r- 

a2CT  -tQ)3  a^T  -tQ)6 _ 

b0(i)=lt  3 jr  +  3Pp(  3rg-a2  CT-tp  )’3 ) 


i=l ,  3 

(8.2.10) 

(8.2. IT) 

(8.2.12) 

a2 (T  -tQ)3 

3re-a2(T  -tQ>3 

J (8 • 2*13) 

b1(i)=Cl+ 


<L^o,  m2+  a“(T  -t°)3  ^ 

R0  '  3rg-a2 CT  -tQ)3 


(8.2.14) 

(8.2.15) 


By  substituting  (8.2.11)  into  (8.2.8)  there  results 
a  second  order  polynomial  in  terms  of  The  roots  of 

this  polynomial  determine  two  initial  state  vectors  which 


-101  - 


o 

( 


are  symmetrical  to  each  other  with  respect  to  the  origin,. 
One  root  is-  superfluous  from  a  physical  viewpoint. 

8.2.1  Procedure  for' Solving  the  Differential  Game’s  Euler- 
Lagrange  Equations  when  the  Terminal 
Engagement  Time  Ts  Unknown 

With  reference  to  (4.3.29-4.3.31)  the  solution  of  the 
differential  game's  Euler-Lagrange  equations  depends  on 
'the  determination  of  the  vector  multipliers-,  Ap(T)  and 
Ae(T).  The  relationships  that  determine  Ap(T)  and  A0(T) 
in  terms  of  the  terminal  engagement  time  are  (8 . 2 . 1-8 . 2 . 3) . 

o 

When  the  terminal  engagement  time  is  unknown ?  the 
additional  boundary  conditions  needed  to  determine  the 


engagement  time  are: 

u(T)s-R  *'1(T)Gt’  (T)A--(£)  ‘  C8.v2.16) 

p  p  p  ’ 

v(T)=Re“1(T)G^(T)Ae(T)  (8.2.17) 

VT)=^(T»tO)xe(tO)+Me(T>tO)Xe(T)+ke(T»tO>  (8.2.18) 

xp(T.)4pCT,t0)xp(t0)-Mp(T,t0)Ap(T)+kp(T,t0)  (8.2.19) 

x  (T)=F  (T)x  (T)+G  (T) v(T)+n  (T)  (8.2.20) 

e  e  e  e  e 

x  (T)  =  F  0  T).x  (T)+G(T)u(T)'+n(T)  (8.2.21) 

P  P  .  P  P  P 

l/2Lu(T)’R  (T)u(T) -v(T)^R  (T) v(T) ] 

P  e 

+a2[x  CT)-x  (T) ] ’ A’ ACx  (T)-x  (T) ]=0  (8.2.22) 

p  e  p  e 


The  procedure  for  determining  the  boundary  costate 
vectors  and  the  terminal  engagement  time  is  as  follows  : 
1)  Choose  a  discrete  value  for  the  terminal  engagement 
time: 
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T=T^+nAT;  n=l,...k  (8.2.23) 

where  T^is  the  initial  terminal  engagement  time  and  AT 
is  the  incremental  change  in  the  terminal  engagement 
time. 

2)  Tor  a  discrete  value  of  T  the  boundary  costate  vectors 
are  determined  by  solving  ( 8 . 2 . 1-8 . 2 . 3) . 

3)  .With  the  determination  of  the  boundary  costate  vectors 

the  boundary  conditions  determined  by  (8.2.16-8.2.21) 
are  determined. 

4)  Substituting  the  boundary  conditions  determined  by 

(8'.  2.16-8. 2.21)  into  (8.2.22)  it  is  determined  whether 
(8.2.22)  is  satisfied. 

5)  If  (3.2.22)  is  not  satisfied,  then  T  is  updated. 
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APPENDIX  8.3. 

Determination  of  the  Terminal  Miss  Distance 
Vector  between  the  Cooperating  Pursuer  and  the 
Evader  in  Terms  of  the.  Evader's  State  Vector 


The  terminal  miss  distance  between  the  evader  and  the 
cooperating  pursuer  is  determined  by 

Min  J_Min |a  2 / 2  fr  (T)-x  (T) ] ' A* A[x  (T ) -x  ( T ) ] 
u  _  u  l  cp  cp  *e  cp  e 


-CP  -cp ;  °P 

T 

+1/2-  /  u  '•  R-  (t)u  dtl 
cp  cp  cp  ) 

0 

subject  to  the  constraints 

x  = F  ( t ) x  +G  ( t )u+n 
cp  cp  cp  cp  cp  cp 

x  ( t  n )  -  x 
cp  0  cpO 


(8.3.1) 


(8.3.2) 

(8.3.3) 


where  the  state  vector  xcp  represents  the  position  and 

velocity  vectors  of  the  cooperating  pursuer ;  Axe(T) ,  the 

evader's  terminal  engagement  position,  is  the  cooperating. 

pursuer's  desired  terminal  position;  the  control 

vector  uCp  is  the  cooperating  pursuer's  acceleration 

command  ;  n^  represents  any  disturbance  vector  such  as  the 

earth's  gravitational  field;  the  6x6  matrix  F  (t)  and  the 

cp 

6x3  matrix  G„(t)  are  continuous  in  time;  R  (t)  is  a  3x3 
cp  cp 

2 

positive  definite  matrix  continuous  in  time;  a^  is  a 
weighting  factor;  T  is  the  fixed  terminal  time. 

The  cooperating  pursuer's  performance  criterion  J 
is  the  square  of.  the  error  norm  between  the  cooperating 
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pursuer's  position  and  its  desired  position ,  weighted 
against  the  energy  spent  by  the  cooperating  pursuer..  The 
dynamics  of  the  cooperating  pursuer  are  defined  by  (8.3.2). 

Adjoining  the  cooperating  pursuer's  differential 
constraint  (8.3.2)  to  the  performance  criterion  by  the 
vector  multiplier  ACp,  the  minimization  of  the  performance 
criterion  is  expressed  as 

MinJo=“in{acp2/2[X  (T)-xe(T)],A'A[x  (T)-xe(TU 

cp  cp 
T 

+  /  [l/2uj  R  (t)u  +A '  (F  (t)x  +6  (t)i^-+n  -x „  )]dti 

J  cp  cp  cp  cp  cp  cp  cp  cp  cp  cp  ) 

t0 

(8.3. 4.), 

The  cooperating  pursuer's  terminal  state  is  determined 

by  solving  the  Euler-Lagrange  equations  that  result  from 

minimizing  Jc«  By  the  method  of  calculus  of  variations  the 

conditions  necessary  for  an  extremum  is  that  the  first  order 

variation  of  J  vanishes 
c 

5  J=  [ac2p  [Xqp  ( T  }  -xe  (T  )]•  A'  A-A0-p  CT  )i3Sxop  (T) 


+ (A  '  +A  'F  (t ) )Sx  3dt=0  (8.3.5) 

cp  cp  cp  cp 

The  Euler-Lagrange  equations  which  result  from  the  dif¬ 
ferential  constraint  (8.3.2)  and  the  necessary  conditions 
resulting  from  equating  the  coefficients  of  the  first  order 
variationals  to  zero  are:. 
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cp  _  cp 

L_  .  o 


-G  (t)R  («el<t)lT  x. 


cp  CP’  cp 

•F'n(t) 

cp 


cpJ.  cp 


(8.3.6) 


subject  to  the  boundary  conditions 

xcp(V=xcpO 

"VT)=acpA’ACVT>-VT):i 

The  solution  for  x^  defined  at  T  is 

cp 

x__.(T)  =$>  ( T , t n )  x  ~ -M„(T »tn)A  (T)  +k  ( T ,t ) 
cp  i'cp'  u  cpu  cp  0  cp  cp  ’0 


(8.3.7) 


(8.3.8) 


(8.3.9) 


where  $cpCT  jtQ)  is  the  transition  matrix;  Mcp(T,t0).,  the 
controllability  matrix, is  defined  as 
T 

M  (T,tn)=  f  $  <T,t)G^(t)R"^(t)G  ’  (t)<J)’  (T,t)dt  (8.3.10) 
cp  U  «/.  xcp  cp  CP  cp  ICP 


J  2TCP 
r0 


and  the  column  vector  kcp(T,tQ).  due  to  the  disturbance 


vector  n  is 
P  T 

k  .  (T,t_)=  /&  ( T,t)n  dt 

cp  0  *0.  *cp  cp 

x0 


(8.3.11) 


Substituting  for  Acp(T),  defined  by  the  boundary  con¬ 
dition,  (8 .  3.  8)  into  (8.3.9) 

x  (T)=5  (T,tn)x  --a*  M  (T^^A'AC*  (T)-xe(T)3 

cp  *cp  0  cpu  cp  cp  0  cp  e 


+k  (T.t.)  (8.3.12) 

cp  u 

Subtracting  xg(T)  from  both  sides  of  (8.3.12)  and  solving 

for  the  error  vector  [x  .  (T)-x  (T)3 

cr.  e 

txep(T)-xe(T>?=tU+acpMcp(T>t0)A'Arlx 

[4p(T>tO)xcpO+kcpCT>tO>-xe(T)’  (8.3.13) 
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The  terminal  miss  distance  vector  between  the  cooperating 

pursuer  and  the  evader  is  obtained  by  premultiplying 

[x  (T)-x  (T)]  by  the  3x6  matrix  A. 
cp  e 


APPENDIX  8.4 


Determination  of  the  Boundary  Costate  Vectors 
in  Terms  of  the  Specific  Parameters  for  the 
Differential  Game  with  the  Cooperating  Pursuer 


The  solution  of  the  following  equations  derived  in 
Section  5.4  determines  the  boundary  costate  vectors,  Xp(T)  and 


X  (T) . 

e 


U+a  A'AM(T 
2  P 


-azA’AMp(T,u0 


T,t0)  a2A’AMeCT,t0)  IXp(T)] 

,tQ)  U-Ca2A,A+yK1,K;L3Me(T,tp)JLXe(T).J 

:a2AtA^(T,t0)  .  -a2A'A$e(T,t0)  “]  Pxe,Ct0) 

_-a2A'A$p(T,t0)  Ca2AlA+yK1,K1%(T,t0)  ][xp<tc) 

kp(T,t0) 


~a2A’A  -a2 A* A 


-a2A'A  a2A'A+yK1,K1. 


VT’Vj 


-y 


Fl^cp^V 


^p^O5 


(8.4.1) 


CK2‘-Xe’(T)Me«(T,tn)]K1’K1CK2.Me(T,t0)Xe(T)3 
..  2 


(8.4.2) 


"  m 
where 


Kl=ACU^4Mop(T,t0)A'firl 


(8.4.3) 


and 


K2=fcp(T>tO,xcpO+kcp('F>tO)-fe«-1:0)xeO-ke(T>^> 

When  the  dynamics  for  the  participants  are  specified  as 

M  =  f°'  “TF^U0!  1 : 1;  K=P.<=P.e 


(8.4.5) 
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epl=l+a‘<T-t0)“X  [l/r  -l/r£3/3 


3ropta2(T-t0)3  X 


3r  +a2(T-t0)3 


(T.t0)' 


a  .  =a 


e3  PD  L  3r 


a2«-»0)3  ,3Va2<T-t„>3 


-l]  i  5=1,2,: 


(8.4.15) 


(8.4.16) 


(8.4.17) 


3r 

bP-i=  - 2^ - 7  X  Cx„»  (tn)-x  .  (tnJ  +  CT-tnJX 

3  L3rcp+a^(T-t0)3J  CP3  0  eD  0  0 

^xcpf+5^t0^’*xej+3^t0^^  D  =  l»2>3 

3r  -a2(T-tn)3  3r 

c  =  _ i. _ 9 *  _ P-. . 

el  3re  3rp+a2(T-tQ)3 


a4(T-tQ)6 

9rerp 


.  3r  +a  (T-tr, 
cp  0 


2  <T-V3 

X  — 


(8.4.18) 


(8.4.19) 


(8.4.20) 


The  unknown  scalar  multiplier  Y  is  determined  by  sub¬ 
stituting  Xe(T)  into  (8.4.2)  and  solving  for  y .  For  the 
dynamics  and  weighting  matrices  specified  by  (8. 4. 5,8. 4. 6) 
the  evader's  quadratic  terminal  miss  distance  constraint 
with  the  cooperating  pursuer1  is  exactly  expressed  in  terms 
of  y  as  a  second  order  polynomial.  The  root  which-  yields 
the  minimum  change  of  control  energy  for  the  evader  due  to 
the  cooperating  pursuer  is  sought.  The  minimum  change  of 
control  energy  is  determined  by  comparing  the  evader's 
control  energy  for  the  differential  game  with  the  cooperating 
pursure  to  the  evader's  control  energy  for  the  game  played 
without  the  cooperating  pursuer  (6). 
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